mirror of https://github.com/mudler/LocalAI.git
0004ec8be3
* Enhance autogptq backend to support VL models * update dependencies for autogptq * remove redundant auto-gptq dependency * Convert base64 to image_url for Qwen-VL model * implemented model inference for qwen-vl * remove user prompt from generated answer * fixed write image error * fixed use_triton issue when loading Qwen-VL model --------- Co-authored-by: Binghua Wu <bingwu@estee.com> |
||
|---|---|---|
| .. | ||
| cpp | ||
| go | ||
| python | ||
| backend.proto | ||
| backend_grpc.pb.go | ||