LocalAI/examples/configurations/phi-2.yaml

name: phi-2
context_size: 2048
f16: true
gpu_layers: 90
mmap: true
trimsuffix: 
- "\n"
parameters:
  model: huggingface://TheBloke/phi-2-GGUF/phi-2.Q8_0.gguf
  temperature: 0.2
  top_k: 40
  top_p: 0.95
template:
  chat: &template |
    Instruct: {{.Input}}
    Output:
  completion: *template
docs(phi-2): add example (#1525) 2024-01-01 09:51:47 +00:00			`name: phi-2`
			`context_size: 2048`
			`f16: true`
			`gpu_layers: 90`
			`mmap: true`
feat: add trimsuffix (#1528) 2024-01-01 13:39:42 +00:00			`trimsuffix:`
			`- "\n"`
docs(phi-2): add example (#1525) 2024-01-01 09:51:47 +00:00			`parameters:`
			`model: huggingface://TheBloke/phi-2-GGUF/phi-2.Q8_0.gguf`
			`temperature: 0.2`
			`top_k: 40`
			`top_p: 0.95`
			`template:`
			`chat: &template \|`
			`Instruct: {{.Input}}`
			`Output:`
			`completion: *template`