Mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-06-07 19:40:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
20d637e7b7
LocalAI/backend/python/exllama
History
ok2sh 20d637e7b7
fix: ExLlama Backend Context Size & Rope Scaling (#1311) 
* fix: context_size not propagated to exllama backend

* fix: exllama rope scaling
2023-11-21 19:26:39 +01:00
..
backend_pb2_grpc.py
backend_pb2.py
exllama.py fix: ExLlama Backend Context Size & Rope Scaling (#1311) 2023-11-21 19:26:39 +01:00
exllama.yml
Makefile
README.md
run.sh

README.md

Creating a separate environment for the exllama project

make exllama