Mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-06-07 19:40:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
efcca15d3f
LocalAI/backend/python/autogptq
History
Sebastian.W b7ffe66219
Enhance autogptq backend to support VL models (#1860) 
* Enhance autogptq backend to support VL models

* update dependencies for autogptq

* remove redundant auto-gptq dependency

* Convert base64 to image_url for Qwen-VL model

* implemented model inference for qwen-vl

* remove user prompt from generated answer

* fixed write image error

---------

Co-authored-by: Binghua Wu <bingwu@estee.com>
2024-03-26 18:48:14 +01:00
..
autogptq.py Enhance autogptq backend to support VL models (#1860) 2024-03-26 18:48:14 +01:00
autogptq.yml Enhance autogptq backend to support VL models (#1860) 2024-03-26 18:48:14 +01:00
backend_pb2_grpc.py refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
backend_pb2.py feat(tts): add Elevenlabs and OpenAI TTS compatibility layer (#1834) 2024-03-14 23:08:34 +01:00
Makefile deps(conda): use transformers environment with autogptq (#1555) 2024-01-06 15:30:53 +01:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
run.sh deps(conda): use transformers environment with autogptq (#1555) 2024-01-06 15:30:53 +01:00

README.md

Creating a separate environment for the autogptq project

make autogptq