LocalAI/extra/grpc
Ettore Di Giacinto bdf3f95346
feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081)
**Description**

this allows to customize the maximum number of grpc workers for python
backends

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-09-19 21:30:39 +02:00
..
autogptq feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081) 2023-09-19 21:30:39 +02:00
bark feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081) 2023-09-19 21:30:39 +02:00
diffusers feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081) 2023-09-19 21:30:39 +02:00
exllama feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081) 2023-09-19 21:30:39 +02:00
huggingface feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081) 2023-09-19 21:30:39 +02:00
vall-e-x feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081) 2023-09-19 21:30:39 +02:00
vllm feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS (#1081) 2023-09-19 21:30:39 +02:00