LocalAI/gallery/openvino.yaml
Ettore Di Giacinto baff5ff8c2
models(gallery): add openvino models (#2184)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-04-29 18:17:47 +02:00

13 lines
204 B
YAML

---
name: openvino
config_file: |
backend: transformers
context_size: 8192
type: OVModelForCausalLM
template:
use_tokenizer_template: true
stopwords:
- "<|eot_id|>"
- "<|end_of_text|>"