Commit Graph

14 Commits

Author SHA1 Message Date
OğuzhanSarisakaloglu
7aad51da7f Fix typo errors in code and readme file. 2023-12-12 18:40:07 -05:00
Christian Tzolov
6d3c429e95 remove the occurances of 'experimenta' in the git urls and docs 2023-12-12 17:48:11 +01:00
Christian Tzolov
11e47c07ef Add vertex ai autoconfig and spring boot
- Add Vertex AI Autoconfigurations for chat and embedding clients.
 - Factor out the embeding client dimensions() computation into an abstract parent AbstractEmbeddingClient.
 - Add ITs
 - Vertex dos.
2023-12-12 17:36:50 +01:00
Mark Pollack
8cc941d5ad move to 0.8.0-SNAPSHOT 2023-12-11 11:53:06 -05:00
Mark Pollack
f6dc8f6bd8 Move documentation that was in README.md into Antora.
* Add minimal ETL pipeline docs

Fixes #137
2023-12-05 21:21:06 -05:00
Christian Tzolov
1ab7ceedff Fix transformers-embedding test’s cross-platform number precision 2023-11-17 12:04:57 +01:00
Christian Tzolov
621aa7d53e Switch to BOM djl dependecies in the transformer-embedding 2023-11-16 16:14:48 +01:00
Christian Tzolov
3ea938c4e1 Transformers-embedding client - align tokenizer with onnx's model inputs 2023-11-15 15:18:22 +01:00
Christian Tzolov
1746bf6b46 Add transformers-embedding boot auto-configuraiton and starter 2023-11-15 12:29:22 +01:00
Christian Tzolov
952ff6c319 Simplify VectorStore interface
- Collapses all VectorStore similiaritySearch methdos into one with SearchRequest builder.
 - Fix all affected code and tests.
 - Bump the project version to 0.7.1.
 - Add tests
 - Add autoconfigurations for milvus, pinecone and pgvecor stores.
 - Improve and unify the VectorStore ITs.
 - Make use of TrasformersEmbeddingClient for auto-configurations ITs.
2023-11-14 15:39:01 -05:00
Christian Tzolov
0a584f0dc2 Transformers embedding Readme clarifications 2023-11-10 08:05:47 +01:00
Christian Tzolov
e423c3f127 Improve transformers embedding readme 2023-11-10 00:22:14 +01:00
Christian Tzolov
a53e3e9f6f Fix transformers embedding client default model uris 2023-10-31 12:29:43 +01:00
Christian Tzolov
6030cda598 Add local, Transformers EmbeddingClient
- EmbeddingClient implementation that computes, locally, sentence embeddings with SBERT transformers.
 - Uses pre-trained transformer models, serialized into Open Neural Network Exchange (ONNX) format.
 - Deep Java Library and the Microsoft ONNX Java Runtime are used to run
   the ONNX models and compute the embeddings efficiently.
 - Add default tokenizer.json and model.onnx for sentence-transformers/all-MiniLM-L6-v2.
 - Add, configurable resource caching service to allow caching
   remote (http/https) resources to the local FS.
 - README.md provides information on how to serialize ONNX models.
 - add Git LFS configuration for large onnx model files.
2023-10-31 12:24:22 +01:00