Ettore Di Giacinto 453e9c5da9 fix(vllm): set default top_p with vllm (#1078) ... **Description** This PR fixes vllm when called with a request with an empty top_p Signed-off-by: Ettore Di Giacinto <mudler@localai.io>		2023-09-19 18:10:23 +02:00
..
autogptq	feat(speculative-sampling): allow to specify a draft model in the model config (#1052)	2023-09-14 17:44:16 +02:00
bark	feat(speculative-sampling): allow to specify a draft model in the model config (#1052)	2023-09-14 17:44:16 +02:00
diffusers	feat(speculative-sampling): allow to specify a draft model in the model config (#1052)	2023-09-14 17:44:16 +02:00
exllama	feat(speculative-sampling): allow to specify a draft model in the model config (#1052)	2023-09-14 17:44:16 +02:00
huggingface	feat(speculative-sampling): allow to specify a draft model in the model config (#1052)	2023-09-14 17:44:16 +02:00
vall-e-x	feat(speculative-sampling): allow to specify a draft model in the model config (#1052)	2023-09-14 17:44:16 +02:00
vllm	fix(vllm): set default top_p with vllm (#1078)	2023-09-19 18:10:23 +02:00