3 Commits

Author	SHA1	Message	Date
Ettore Di Giacinto	bdf3f95346	feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081) ... **Description** this allows to customize the maximum number of grpc workers for python backends Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-09-19 21:30:39 +02:00
Ettore Di Giacinto	afdc0ebfd7	feat: add --single-active-backend to allow only one backend active at the time (#925) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-08-19 01:49:33 +02:00
Ettore Di Giacinto	ff3ab5fcca	feat: Add exllama (#881) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-08-11 00:49:40 +02:00