6 Commits

Author	SHA1	Message	Date
Ettore Di Giacinto	cc060a283d	fix: drop racy code, refactor and group API schema (#931) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-08-20 14:04:45 +02:00
Dave	8cb1061c11	Usage Features (#863)	2023-08-18 21:23:14 +02:00
Dave	7fb8b4191f	feat: "simple" chat/edit/completion template system prompt from config (#856)	2023-08-03 00:19:55 +02:00
Aman Gupta Karmani	12fe0932c4	feat: cancel stream generation if client disappears (#792)	2023-07-24 23:10:54 +02:00
Dave	c6bf67f446	feat(llama2): add template for chat messages (#782) ... Co-authored-by: Aman Karmani <aman@tmm1.net> Lays some of the groundwork for LLAMA2 compatibility as well as other future models with complex prompting schemes. Started small refactoring in pkg/model/loader.go regarding template loading. Currently still a part of ModelLoader, but should be easy to add template loading for situations other than overall prompt templates and the new chat-specific per-message templates Adds support for new chat-endpoint-specific, per-message templates as an alternative to the existing Role: XYZ sprintf method. Includes a temporary prompt template as an example, since I have a few questions before we merge in the model-gallery side changes (see ) Minor debug logging changes.	2023-07-22 11:31:39 -04:00
Ettore Di Giacinto	5dcfdbe51d	feat: various refactorings ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2023-07-15 01:19:43 +02:00