Mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-06-07 19:40:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
941 Commits 23 Branches 89 Tags 18 MiB
92cbc4d516
Commit Graph

3 Commits

Author SHA1 Message Date
Ettore Di Giacinto
548959b50f
feat: queue up requests if not running parallel requests (#1296) 
Return a GRPC which handles a lock in case it is not meant to be
parallel.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-11-16 22:20:16 +01:00
Ettore Di Giacinto
fdd95d1d86
feat: allow to run parallel requests (#1290) 
* feat: allow to run parallel requests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixup

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-11-16 08:20:05 +01:00
Ettore Di Giacinto
afdc0ebfd7
feat: add --single-active-backend to allow only one backend active at the time (#925) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-19 01:49:33 +02:00