LocalAI/api/backend
Ettore Di Giacinto a28ab18987
feat(vllm): Allow to set quantization (#1094)
This particularly useful to set AWQ

**Description**

Follow up of #1015 

**Notes for Reviewers**


**[Signed
commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)**
- [ ] Yes, I signed my commits.
 

<!--
Thank you for contributing to LocalAI! 

Contributing Conventions:

1. Include descriptive PR titles with [<component-name>] prepended.
2. Build and test your changes before submitting a PR. 
3. Sign your commits

By following the community's contribution conventions upfront, the
review process will
be accelerated and your PR merged more quickly.
-->

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-09-22 15:52:38 +02:00
..
embeddings.go feat: add --single-active-backend to allow only one backend active at the time (#925) 2023-08-19 01:49:33 +02:00
image.go feat(diffusers): Add lora (#965) 2023-08-27 10:11:16 +02:00
llm.go fix(utf8): prevent multi-byte utf8 characters from being mangled (#981) 2023-08-30 23:56:59 +00:00
options.go feat(vllm): Allow to set quantization (#1094) 2023-09-22 15:52:38 +02:00
transcript.go fix: drop racy code, refactor and group API schema (#931) 2023-08-20 14:04:45 +02:00
tts.go feat: add --single-active-backend to allow only one backend active at the time (#925) 2023-08-19 01:49:33 +02:00