models(gallery): add biomistral-7b (#2161)

* models(gallery): add biomistral-7b

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

* add <|end_of_text|> to llama3 as stopword

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

---------

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
This commit is contained in:
Ettore Di Giacinto 2024-04-28 12:04:04 +02:00 committed by GitHub
parent a248ede222
commit a8089494fd
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
2 changed files with 15 additions and 0 deletions

View File

@ -698,6 +698,20 @@
- filename: "Hermes-2-Pro-Mistral-7B.Q8_0.gguf"
sha256: "b6d95d7ec9a395b7568cc94b0447fd4f90b6f69d6e44794b1fbb84e3f732baca"
uri: "huggingface://NousResearch/Hermes-2-Pro-Mistral-7B-GGUF/Hermes-2-Pro-Mistral-7B.Q8_0.gguf"
- <<: *hermes-2-pro-mistral
name: "biomistral-7b"
description: |
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains
urls:
- https://huggingface.co/MaziyarPanahi/BioMistral-7B-GGUF
icon: https://huggingface.co/BioMistral/BioMistral-7B/resolve/main/wordart_blue_m_rectangle.png?download=true
overrides:
parameters:
model: BioMistral-7B.Q4_K_M.gguf
files:
- filename: "BioMistral-7B.Q4_K_M.gguf"
sha256: "3a73107045dfe7e3f113b392b0a67e3e6ca9fa9dae2abe301424ce5abd1721a6"
uri: "huggingface://MaziyarPanahi/BioMistral-7B-GGUF/BioMistral-7B.Q4_K_M.gguf"
### END Hermes-2-Pro-Mistral
### START Cerbero
- url: "github:mudler/LocalAI/gallery/cerbero.yaml@master"

View File

@ -41,3 +41,4 @@ config_file: |
- <|im_end|>
- <dummy32000>
- "<|eot_id|>"
- <|end_of_text|>