LocalAI/backend/python
Ettore Di Giacinto 92cbc4d516
feat(transformers): add embeddings with Automodel (#1308)
* Update huggingface.py

Switch SentenceTransformer for AutoModel in order to set trust_remote_code needed to use the encode method with embeddings models like jinai-v2

Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu>

* feat(transformers): split in separate backend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Lucas Hänke de Cansino <lhc@next-boss.eu>
2023-11-20 21:21:17 +01:00
..
autogptq refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
bark refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
diffusers refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
exllama refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
sentencetransformers feat(transformers): add embeddings with Automodel (#1308) 2023-11-20 21:21:17 +01:00
transformers feat(transformers): add embeddings with Automodel (#1308) 2023-11-20 21:21:17 +01:00
vall-e-x refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
vllm refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>