LocalAI/pkg/grpc
Ludovic Leroux 939411300a
Bump vLLM version + more options when loading models in vLLM (#1782)
* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama
2024-03-01 22:48:53 +01:00
..
base MQTT Startup Refactoring Part 1: core/ packages part 1 (#1728) 2024-02-21 01:21:19 +00:00
proto Bump vLLM version + more options when loading models in vLLM (#1782) 2024-03-01 22:48:53 +01:00
backend.go MQTT Startup Refactoring Part 1: core/ packages part 1 (#1728) 2024-02-21 01:21:19 +00:00
client.go MQTT Startup Refactoring Part 1: core/ packages part 1 (#1728) 2024-02-21 01:21:19 +00:00
embed.go MQTT Startup Refactoring Part 1: core/ packages part 1 (#1728) 2024-02-21 01:21:19 +00:00
interface.go MQTT Startup Refactoring Part 1: core/ packages part 1 (#1728) 2024-02-21 01:21:19 +00:00
server.go feat(grpc): backend SPI pluggable in embedding mode (#1621) 2024-01-23 08:56:36 +01:00