LocalAI/backend/python/sentencetransformers
Ettore Di Giacinto 92cbc4d516
feat(transformers): add embeddings with Automodel (#1308)
* Update huggingface.py

Switch SentenceTransformer for AutoModel in order to set trust_remote_code needed to use the encode method with embeddings models like jinai-v2

Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu>

* feat(transformers): split in separate backend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Lucas Hänke de Cansino <lhc@next-boss.eu>
2023-11-20 21:21:17 +01:00
..
backend_pb2_grpc.py feat(transformers): add embeddings with Automodel (#1308) 2023-11-20 21:21:17 +01:00
backend_pb2.py feat(transformers): add embeddings with Automodel (#1308) 2023-11-20 21:21:17 +01:00
Makefile feat(transformers): add embeddings with Automodel (#1308) 2023-11-20 21:21:17 +01:00
README.md feat(transformers): add embeddings with Automodel (#1308) 2023-11-20 21:21:17 +01:00
run.sh feat(transformers): add embeddings with Automodel (#1308) 2023-11-20 21:21:17 +01:00
sentencetransformers.py feat(transformers): add embeddings with Automodel (#1308) 2023-11-20 21:21:17 +01:00
sentencetransformers.yml feat(transformers): add embeddings with Automodel (#1308) 2023-11-20 21:21:17 +01:00
test_sentencetransformers.py feat(transformers): add embeddings with Automodel (#1308) 2023-11-20 21:21:17 +01:00
test.sh feat(transformers): add embeddings with Automodel (#1308) 2023-11-20 21:21:17 +01:00

Creating a separate environment for the sentencetransformers project

make sentencetransformers