LocalAI/backend/python
Ettore Di Giacinto 887b3dff04
feat: cuda transformers (#1401)
* Use cuda in transformers if available

tensorflow probably needs a different check.

Signed-off-by: Erich Schubert <kno10@users.noreply.github.com>

* feat: expose CUDA at top level

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* tests: add to tests and create workflow for py extra backends

* doc: update note on how to use core images

---------

Signed-off-by: Erich Schubert <kno10@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Erich Schubert <kno10@users.noreply.github.com>
2023-12-08 15:45:04 +01:00
..
autogptq Feat: new backend: transformers-musicgen (#1387) 2023-12-08 10:01:02 +01:00
bark Feat: new backend: transformers-musicgen (#1387) 2023-12-08 10:01:02 +01:00
diffusers Feat: new backend: transformers-musicgen (#1387) 2023-12-08 10:01:02 +01:00
exllama Feat: new backend: transformers-musicgen (#1387) 2023-12-08 10:01:02 +01:00
exllama2 exllama(v2): fix exllamav1, add exllamav2 (#1384) 2023-12-05 08:15:37 +01:00
petals Feat: new backend: transformers-musicgen (#1387) 2023-12-08 10:01:02 +01:00
sentencetransformers Feat: new backend: transformers-musicgen (#1387) 2023-12-08 10:01:02 +01:00
transformers feat: cuda transformers (#1401) 2023-12-08 15:45:04 +01:00
transformers-musicgen Feat: new backend: transformers-musicgen (#1387) 2023-12-08 10:01:02 +01:00
vall-e-x Feat: new backend: transformers-musicgen (#1387) 2023-12-08 10:01:02 +01:00
vllm Feat: new backend: transformers-musicgen (#1387) 2023-12-08 10:01:02 +01:00
README.md

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>