coyzeng
|
d5d82ba344
|
feat(grpc): backend SPI pluggable in embedding mode (#1621)
* run server
* grpc backend embedded support
* backend providable
|
2024-01-23 08:56:36 +01:00 |
|
Ettore Di Giacinto
|
e19d7226f8
|
feat: more embedded models, coqui fixes, add model usage and description (#1556)
* feat: add model descriptions and usage
* remove default model gallery
* models: add embeddings and tts
* docs: update table
* docs: updates
* images: cleanup pip cache after install
* images: always run apt-get clean
* ux: improve gRPC connection errors
* ux: improve some messages
* fix: fix coqui when no AudioPath is passed by
* embedded: add more models
* Add usage
* Reorder table
|
2024-01-08 00:37:02 +01:00 |
|
Ettore Di Giacinto
|
db926896bd
|
Revert "[Refactor]: Core/API Split" (#1550)
Revert "[Refactor]: Core/API Split (#1506)"
This reverts commit ab7b4d5ee9.
|
2024-01-05 18:04:46 +01:00 |
|
Dave
|
ab7b4d5ee9
|
[Refactor]: Core/API Split (#1506)
Refactors api folder to core, creates firm split between backend code and api frontend.
|
2024-01-05 15:34:56 +01:00 |
|
Ettore Di Giacinto
|
824612f1b4
|
feat: initial watchdog implementation (#1341)
* feat: initial watchdog implementation
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
* fiuxups
* Add more output
* wip: idletime checker
* wire idle watchdog checks
* enlarge watchdog time window
* small fixes
* Use stopmodel
* Always delete process
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2023-11-26 18:36:23 +01:00 |
|
Ettore Di Giacinto
|
548959b50f
|
feat: queue up requests if not running parallel requests (#1296)
Return a GRPC which handles a lock in case it is not meant to be
parallel.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2023-11-16 22:20:16 +01:00 |
|
Ettore Di Giacinto
|
cc060a283d
|
fix: drop racy code, refactor and group API schema (#931)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2023-08-20 14:04:45 +02:00 |
|
Ettore Di Giacinto
|
afdc0ebfd7
|
feat: add --single-active-backend to allow only one backend active at the time (#925)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2023-08-19 01:49:33 +02:00 |
|
Dave
|
8cb1061c11
|
Usage Features (#863)
|
2023-08-18 21:23:14 +02:00 |
|
Ettore Di Giacinto
|
b96e30e66c
|
fix: use bytes in gRPC proto instead of strings (#813)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2023-07-27 18:41:04 +02:00 |
|
Ettore Di Giacinto
|
1d0ed95a54
|
feat: move other backends to grpc
This finally makes everything more consistent
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2023-07-15 01:19:43 +02:00 |
|
Ettore Di Giacinto
|
58f6aab637
|
feat: move llama to a grpc
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2023-07-15 01:19:43 +02:00 |
|
Ettore Di Giacinto
|
b816009db0
|
feat: add falcon ggllm via grpc client
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
|
2023-07-15 01:19:43 +02:00 |
|