LocalAI/backend/python/exllama
ok2sh 20d637e7b7
fix: ExLlama Backend Context Size & Rope Scaling (#1311)
* fix: context_size not propagated to exllama backend

* fix: exllama rope scaling
2023-11-21 19:26:39 +01:00
..
backend_pb2_grpc.py refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
backend_pb2.py refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
exllama.py fix: ExLlama Backend Context Size & Rope Scaling (#1311) 2023-11-21 19:26:39 +01:00
exllama.yml refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
Makefile refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
run.sh refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00

Creating a separate environment for the exllama project

make exllama