LocalAI/backend/python
fakezeta fea9522982
fix: OpenVINO winograd always disabled (#2252)
Winograd convolutions were always disabled giving error when inference device was CPU.
This commit implement logic to disable Winograd convolutions only if CPU or NPU are declared.
2024-05-07 08:38:58 +02:00
..
autogptq fix: bring everything onto the same GRPC version to fix tests (#2199) 2024-04-30 19:12:15 +00:00
bark fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
common-env/transformers fix: bring everything onto the same GRPC version to fix tests (#2199) 2024-04-30 19:12:15 +00:00
coqui fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
diffusers fix: bring everything onto the same GRPC version to fix tests (#2199) 2024-04-30 19:12:15 +00:00
exllama fix: bring everything onto the same GRPC version to fix tests (#2199) 2024-04-30 19:12:15 +00:00
exllama2 fix: bring everything onto the same GRPC version to fix tests (#2199) 2024-04-30 19:12:15 +00:00
mamba fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
parler-tts fix: bring everything onto the same GRPC version to fix tests (#2199) 2024-04-30 19:12:15 +00:00
petals fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
rerankers feat(rerankers): Add new backend, support jina rerankers API (#2121) 2024-04-25 00:19:02 +02:00
sentencetransformers fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
transformers fix: OpenVINO winograd always disabled (#2252) 2024-05-07 08:38:58 +02:00
transformers-musicgen feat(parler-tts): Add new backend (#2027) 2024-04-13 18:59:21 +02:00
vall-e-x fix: bring everything onto the same GRPC version to fix tests (#2199) 2024-04-30 19:12:15 +00:00
vllm Add tensor_parallel_size setting to vllm setting items (#2085) 2024-04-20 14:37:02 +00:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>