Ettore Di Giacinto a28ab18987 feat(vllm): Allow to set quantization (#1094) ... This particularly useful to set AWQ **Description** Follow up of #1015 **Notes for Reviewers** **[Signed commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)** - [ ] Yes, I signed my commits. <!-- Thank you for contributing to LocalAI! Contributing Conventions: 1. Include descriptive PR titles with [<component-name>] prepended. 2. Build and test your changes before submitting a PR. 3. Sign your commits By following the community's contribution conventions upfront, the review process will be accelerated and your PR merged more quickly. --> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>		2023-09-22 15:52:38 +02:00
..
assets	feat: Update gpt4all, support multiple implementations in runtime (#472)	2023-06-01 23:38:52 +02:00
backend	feat(speculative-sampling): allow to specify a draft model in the model config (#1052)	2023-09-14 17:44:16 +02:00
gallery	feat: Model Gallery Endpoint Refactor / Mutable Galleries Endpoints (#991)	2023-09-02 09:00:44 +02:00
grammar	feat: update integer, number and string rules - allow primitives as root types (#862)	2023-08-03 23:32:30 +02:00
grpc	feat(vllm): Allow to set quantization (#1094)	2023-09-22 15:52:38 +02:00
langchain	feat: add LangChainGo Huggingface backend (#446)	2023-06-01 12:00:06 +02:00
model	feat: backend monitor shutdown endpoint, process based (#938)	2023-08-23 18:38:37 +02:00
stablediffusion	feat: support upscaled image generation with esrgan (#509)	2023-06-05 17:21:38 +02:00
utils	feat: Model Gallery Endpoint Refactor / Mutable Galleries Endpoints (#991)	2023-09-02 09:00:44 +02:00