LocalAI/backend
Sebastian.W b7ffe66219
Enhance autogptq backend to support VL models (#1860)
* Enhance autogptq backend to support VL models

* update dependencies for autogptq

* remove redundant auto-gptq dependency

* Convert base64 to image_url for Qwen-VL model

* implemented model inference for qwen-vl

* remove user prompt from generated answer

* fixed write image error

---------

Co-authored-by: Binghua Wu <bingwu@estee.com>
2024-03-26 18:48:14 +01:00
..
cpp test/fix: OSX Test Repair (#1843) 2024-03-18 19:19:43 +01:00
go feat(stores): Vector store backend (#1795) 2024-03-22 21:14:04 +01:00
python Enhance autogptq backend to support VL models (#1860) 2024-03-26 18:48:14 +01:00
backend_grpc.pb.go transformers: correctly load automodels (#1643) 2024-01-26 00:13:21 +01:00
backend.proto feat(stores): Vector store backend (#1795) 2024-03-22 21:14:04 +01:00