LocalAI/backend/python
fakezeta 66b002458d
Transformer Backend: Implementing use_tokenizer_template and stop_prompts options (#2090)
* fix regression #1971

fixes regression #1971 introduced by intel_extension_for_transformers==1.4

* UseTokenizerTemplate and StopPrompt

Implementation of use_tokenizer_template and stopwords options
2024-04-21 16:20:25 +00:00
..
autogptq fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
bark fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
common-env/transformers feat: add flash-attn in nvidia and rocm envs (#1995) 2024-04-11 09:44:39 +02:00
coqui fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
diffusers fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
exllama fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
exllama2 fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
mamba fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
parler-tts feat(parler-tts): Add new backend (#2027) 2024-04-13 18:59:21 +02:00
petals fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
sentencetransformers fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
transformers Transformer Backend: Implementing use_tokenizer_template and stop_prompts options (#2090) 2024-04-21 16:20:25 +00:00
transformers-musicgen feat(parler-tts): Add new backend (#2027) 2024-04-13 18:59:21 +02:00
vall-e-x fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
vllm Add tensor_parallel_size setting to vllm setting items (#2085) 2024-04-20 14:37:02 +00:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>