LocalAI/backend/python
fenfir fb0a4c5d9a
Build docker container for ROCm (#1595)
* Dockerfile changes to build for ROCm

* Adjust linker flags for ROCm

* Update conda env for diffusers and transformers to use ROCm pytorch

* Update transformers conda env for ROCm

* ci: build hipblas images

* fixup rebase

* use self-hosted

Signed-off-by: mudler <mudler@localai.io>

* specify LD_LIBRARY_PATH only when BUILD_TYPE=hipblas

---------

Signed-off-by: mudler <mudler@localai.io>
Co-authored-by: mudler <mudler@localai.io>
2024-02-16 15:08:50 +01:00
..
autogptq transformers: correctly load automodels (#1643) 2024-01-26 00:13:21 +01:00
bark transformers: correctly load automodels (#1643) 2024-01-26 00:13:21 +01:00
common-env/transformers Build docker container for ROCm (#1595) 2024-02-16 15:08:50 +01:00
coqui transformers: correctly load automodels (#1643) 2024-01-26 00:13:21 +01:00
diffusers Build docker container for ROCm (#1595) 2024-02-16 15:08:50 +01:00
exllama transformers: correctly load automodels (#1643) 2024-01-26 00:13:21 +01:00
exllama2 fix(python): pin exllama2 (#1711) 2024-02-14 21:44:12 +01:00
mamba fix(python): pin exllama2 (#1711) 2024-02-14 21:44:12 +01:00
petals transformers: correctly load automodels (#1643) 2024-01-26 00:13:21 +01:00
sentencetransformers transformers: correctly load automodels (#1643) 2024-01-26 00:13:21 +01:00
transformers transformers: correctly load automodels (#1643) 2024-01-26 00:13:21 +01:00
transformers-musicgen transformers: correctly load automodels (#1643) 2024-01-26 00:13:21 +01:00
vall-e-x fix(python): pin exllama2 (#1711) 2024-02-14 21:44:12 +01:00
vllm transformers: correctly load automodels (#1643) 2024-01-26 00:13:21 +01:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Common commands about conda environment

Create a new empty conda environment

conda create --name <env-name> python=<your version> -y

conda create --name autogptq python=3.11 -y

To activate the environment

As of conda 4.4

conda activate autogptq

The conda version older than 4.4

source activate autogptq

Install the packages to your environment

Sometimes you need to install the packages from the conda-forge channel

By using conda

conda install <your-package-name>

conda install -c conda-forge <your package-name>

Or by using pip

pip install <your-package-name>