Mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-06-07 19:40:48 +00:00
Code Issues Packages Projects Releases Wiki Activity

llava.yaml (yaml format standardization) (#1303)

Browse Source 
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
This commit is contained in:
lunamidori5 2023-11-18 05:48:54 -08:00 committed by GitHub
parent b5af87fc6c
commit ccd87cd9f0
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
examples/configurations/llava/llava.yaml
View File

@ -1,11 +1,10 @@
backend: llama-cpp
context_size: 4096
f16: true
threads: 11
gpu_layers: 90
name: llava
mmap: true
backend: llama-cpp
name: llava
roles:
user: "USER:"
assistant: "ASSISTANT:"
@ -17,4 +16,4 @@ parameters:
top_p: 0.95
template:
chat: chat-simple
mmproj: mmproj-model-f16.gguf
mmproj: mmproj-model-f16.gguf