LocalAI/backend/python
Ettore Di Giacinto 2b2d6673ff
exllama(v2): fix exllamav1, add exllamav2 (#1384)
* fix(exllama): fix exllama deps with anaconda

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(exllamav2): add exllamav2 backend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-12-05 08:15:37 +01:00
..
autogptq fix/docs: Python backend dependencies (#1360) 2023-11-30 17:46:55 +01:00
bark fix/docs: Python backend dependencies (#1360) 2023-11-30 17:46:55 +01:00
diffusers fix/docs: Python backend dependencies (#1360) 2023-11-30 17:46:55 +01:00
exllama exllama(v2): fix exllamav1, add exllamav2 (#1384) 2023-12-05 08:15:37 +01:00
exllama2 exllama(v2): fix exllamav1, add exllamav2 (#1384) 2023-12-05 08:15:37 +01:00
petals fix/docs: Python backend dependencies (#1360) 2023-11-30 17:46:55 +01:00
sentencetransformers fix/docs: Python backend dependencies (#1360) 2023-11-30 17:46:55 +01:00
transformers fix/docs: Python backend dependencies (#1360) 2023-11-30 17:46:55 +01:00
vall-e-x fix(vall-e-x): correctly install reqs in environment (#1377) 2023-12-03 21:16:36 +01:00
vllm fix/docs: Python backend dependencies (#1360) 2023-11-30 17:46:55 +01:00
README.md

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>