LocalAI/backend/python
Ettore Di Giacinto 5e335eaead
feat(transformers): support also text generation (#1630)
* feat(transformers): support also text generation

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* embedded: set seed -1

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-01-23 23:07:31 +01:00
..
autogptq deps(conda): use transformers environment with autogptq (#1555) 2024-01-06 15:30:53 +01:00
bark feat(conda): share envs with transformer-based backends (#1465) 2023-12-21 08:35:15 +01:00
common-env/transformers feat: more embedded models, coqui fixes, add model usage and description (#1556) 2024-01-08 00:37:02 +01:00
coqui feat: 🐍 add mamba support (#1589) 2024-01-19 23:42:50 +01:00
diffusers fix(diffusers): add omegaconf dependency (#1540) 2024-01-04 00:06:41 +01:00
exllama feat: more embedded models, coqui fixes, add model usage and description (#1556) 2024-01-08 00:37:02 +01:00
exllama2 feat: more embedded models, coqui fixes, add model usage and description (#1556) 2024-01-08 00:37:02 +01:00
mamba feat(extra-backends): Improvements, adding mamba example (#1618) 2024-01-20 17:56:08 +01:00
petals deps(conda): use transformers-env with vllm,exllama(2) (#1554) 2024-01-06 13:32:28 +01:00
sentencetransformers feat(conda): share envs with transformer-based backends (#1465) 2023-12-21 08:35:15 +01:00
transformers feat(transformers): support also text generation (#1630) 2024-01-23 23:07:31 +01:00
transformers-musicgen feat(conda): share envs with transformer-based backends (#1465) 2023-12-21 08:35:15 +01:00
vall-e-x feat: more embedded models, coqui fixes, add model usage and description (#1556) 2024-01-08 00:37:02 +01:00
vllm feat(extra-backends): Improvements, adding mamba example (#1618) 2024-01-20 17:56:08 +01:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>