LocalAI/backend/python
Ettore Di Giacinto 06cd9ef98d
feat(extra-backends): Improvements, adding mamba example (#1618)
* feat(extra-backends): Improvements

vllm: add max_tokens, wire up stream event
mamba: fixups, adding examples for mamba-chat

* examples(mamba-chat): add

* docs: update
2024-01-20 17:56:08 +01:00
..
autogptq deps(conda): use transformers environment with autogptq (#1555) 2024-01-06 15:30:53 +01:00
bark feat(conda): share envs with transformer-based backends (#1465) 2023-12-21 08:35:15 +01:00
common-env/transformers feat: more embedded models, coqui fixes, add model usage and description (#1556) 2024-01-08 00:37:02 +01:00
coqui feat: 🐍 add mamba support (#1589) 2024-01-19 23:42:50 +01:00
diffusers fix(diffusers): add omegaconf dependency (#1540) 2024-01-04 00:06:41 +01:00
exllama feat: more embedded models, coqui fixes, add model usage and description (#1556) 2024-01-08 00:37:02 +01:00
exllama2 feat: more embedded models, coqui fixes, add model usage and description (#1556) 2024-01-08 00:37:02 +01:00
mamba feat(extra-backends): Improvements, adding mamba example (#1618) 2024-01-20 17:56:08 +01:00
petals deps(conda): use transformers-env with vllm,exllama(2) (#1554) 2024-01-06 13:32:28 +01:00
sentencetransformers feat(conda): share envs with transformer-based backends (#1465) 2023-12-21 08:35:15 +01:00
transformers feat(conda): share envs with transformer-based backends (#1465) 2023-12-21 08:35:15 +01:00
transformers-musicgen feat(conda): share envs with transformer-based backends (#1465) 2023-12-21 08:35:15 +01:00
vall-e-x feat: more embedded models, coqui fixes, add model usage and description (#1556) 2024-01-08 00:37:02 +01:00
vllm feat(extra-backends): Improvements, adding mamba example (#1618) 2024-01-20 17:56:08 +01:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>