LocalAI/backend/python
fakezeta 6ef78ef7f6
bugfix: CUDA acceleration not working (#2475)
* bugfix: CUDA acceleration not working

CUDA not working after #2286.
Refactored the code to be more polish

* Update requirements.txt

Missing imports

Signed-off-by: fakezeta <fakezeta@gmail.com>

* Update requirements.txt

Signed-off-by: fakezeta <fakezeta@gmail.com>

---------

Signed-off-by: fakezeta <fakezeta@gmail.com>
2024-06-03 22:41:42 +02:00
..
autogptq fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
bark fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
common fix: install pytorch from proper index for hipblas builds (#2413) 2024-05-26 18:05:52 +00:00
coqui TTS API improvements (#2308) 2024-06-01 18:26:27 +00:00
diffusers fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
exllama dependencies(grpcio): bump to fix CI issues (#2362) 2024-05-21 14:33:47 +02:00
exllama2 dependencies(grpcio): bump to fix CI issues (#2362) 2024-05-21 14:33:47 +02:00
mamba dependencies(grpcio): bump to fix CI issues (#2362) 2024-05-21 14:33:47 +02:00
openvoice fix: install pytorch from proper index for hipblas builds (#2413) 2024-05-26 18:05:52 +00:00
parler-tts fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
petals fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
rerankers fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
sentencetransformers fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
transformers bugfix: CUDA acceleration not working (#2475) 2024-06-03 22:41:42 +02:00
transformers-musicgen fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
vall-e-x fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
vllm fix: pin version of setuptools for intel builds to work around #2406 (#2414) 2024-05-26 18:27:07 +00:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>