Mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-06-07 19:40:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
763 Commits 23 Branches 89 Tags 18 MiB
0d6165e481
Commit Graph

146 Commits

Author SHA1 Message Date
Ettore Di Giacinto
cc060a283d
fix: drop racy code, refactor and group API schema (#931) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-20 14:04:45 +02:00
Ettore Di Giacinto
28db83e17b
fix: disable usage by default (still experimental) (#929) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-19 16:15:22 +02:00
Ettore Di Giacinto
afdc0ebfd7
feat: add --single-active-backend to allow only one backend active at the time (#925) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-19 01:49:33 +02:00
Ettore Di Giacinto
1079b18ff7
feat(diffusers): be consistent with pipelines, support also depthimg2img (#926) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-18 22:06:24 +02:00
Dave
8cb1061c11
Usage Features (#863) 2023-08-18 21:23:14 +02:00
Ettore Di Giacinto
2bacd0180d
feat(diffusers): add img2img and clip_skip, support more kernels schedulers (#906) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-17 23:38:59 +02:00
Ettore Di Giacinto
37700f2d98
feat(diffusers): add DPMSolverMultistepScheduler++, DPMSolverMultistepSchedulerSDE++, guidance_scale (#903) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-16 01:11:42 +02:00
Ettore Di Giacinto
0ec695f9e4
feat: make initializer accept gRPC delay times (#900) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-16 01:11:32 +02:00
Ettore Di Giacinto
a96c3bc885
feat(diffusers): various enhancements (#895) 2023-08-14 23:12:00 +02:00
Michael Nesbitt
1d1cae8e4d
feat: add API_KEY list support (#877) 
Co-authored-by: Harold Sun <sunhua@amazon.com>
 2023-08-10 00:06:21 +02:00
Ettore Di Giacinto
8c781a6a44
feat: Add Diffusers (#874) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-09 08:38:51 +02:00
Ettore Di Giacinto
3c8fc37c56 feat: Add UseFastTokenizer 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-08 01:10:05 +02:00
Ettore Di Giacinto
433605e282 feat: add initial Bark backend implementation 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-07 22:53:28 +02:00
Ettore Di Giacinto
a843e64fc2 feat: add initial AutoGPTQ backend implementation 2023-08-07 22:53:28 +02:00
Ettore Di Giacinto
acd829a7a0
fix: do not break on newlines on function returns (#864) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-04 21:46:36 +02:00
Ettore Di Giacinto
5ca21ee398
feat: add ngqa and RMSNormEps parameters (#860) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-03 00:51:08 +02:00
Dave
7fb8b4191f
feat: "simple" chat/edit/completion template system prompt from config (#856) 2023-08-03 00:19:55 +02:00
Ettore Di Giacinto
c309aac8f5
fix(gallery): use inline YAML (#851) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-01 19:09:32 +02:00
Ettore Di Giacinto
d603a9cbb5
fix(gallery): preload from file should by in YAML format (#846) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-31 21:13:16 +02:00
Dave
ce8e9dc690
feature: model list :: filter query string parameter (#830) 2023-07-31 19:14:32 +02:00
Dave
8e8d474ae8
refactor: Remove remaining uses of depreciated package io/ioutil (#837) 2023-07-30 11:23:43 +00:00
Ettore Di Giacinto
e70b91aaef tests: set a small context_size 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-29 10:29:47 +02:00
Ettore Di Giacinto
f085baa77d fix: set default rope if not specified 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-29 01:07:16 +02:00
Ettore Di Giacinto
dde12b492b
fix: select function calls if 'name' is set in the request (#827) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-28 01:17:11 +02:00
Ettore Di Giacinto
096d98c3d9
fix: add rope settings during model load, fix CUDA (#821) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-27 21:56:05 +02:00
Ettore Di Giacinto
b96e30e66c
fix: use bytes in gRPC proto instead of strings (#813) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-27 18:41:04 +02:00
Ettore Di Giacinto
569c1d1163
feat: add rope settings and negative prompt, drop grammar backend (#797) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-25 19:05:27 +02:00
Aman Gupta Karmani
12fe0932c4
feat: cancel stream generation if client disappears (#792) 2023-07-24 23:10:54 +02:00
Dave
c6bf67f446
feat(llama2): add template for chat messages (#782) 
Co-authored-by: Aman Karmani <aman@tmm1.net>

Lays some of the groundwork for LLAMA2 compatibility as well as other future models with complex prompting schemes.

Started small refactoring in pkg/model/loader.go regarding template loading. Currently still a part of ModelLoader, but should be easy to add template loading for situations other than overall prompt templates and the new chat-specific per-message templates
Adds support for new chat-endpoint-specific, per-message templates as an alternative to the existing Role: XYZ sprintf method.
Includes a temporary prompt template as an example, since I have a few questions before we merge in the model-gallery side changes (see )
Minor debug logging changes.
 2023-07-22 11:31:39 -04:00
Ettore Di Giacinto
94817b557c
fix: make completions endpoint more close to OpenAI specification (#790) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-22 00:53:52 +02:00
Ettore Di Giacinto
c71c729bc2 debug 2023-07-21 10:53:26 +02:00
Ettore Di Giacinto
e459f114cd fix: fix tests, small refactors 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 23:52:04 +02:00
Ettore Di Giacinto
982a7e86a8 feat: add huggingface embeddings backend 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 22:10:42 +02:00
Ettore Di Giacinto
94916749c5 feat: add external grpc and model autoloading 2023-07-20 22:10:12 +02:00
Ettore Di Giacinto
1d2ae46ddc tests: clean up logs 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 01:36:34 +02:00
Ettore Di Giacinto
3feb632eb4
refactor: rename "llama-master" and "llama" (#776) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 00:36:16 +02:00
Ettore Di Giacinto
6352448b72
feat: add llama-master backend (#752) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-17 23:58:15 +02:00
Ettore Di Giacinto
d0e67cce75 fix: make last stream message to send empty content 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-16 00:09:28 +02:00
Ettore Di Giacinto
17294ae5e5
fix: make first stream message to send empty content (#751) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-15 22:50:52 +02:00
Ettore Di Giacinto
1d0ed95a54 feat: move other backends to grpc 
This finally makes everything more consistent

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-15 01:19:43 +02:00
Ettore Di Giacinto
5dcfdbe51d feat: various refactorings 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-15 01:19:43 +02:00
Ettore Di Giacinto
f2f1d7fe72 feat: use gRPC for transformers 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-15 01:19:43 +02:00
Ettore Di Giacinto
ae533cadef feat: move gpt4all to a grpc service 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-15 01:19:43 +02:00
Ettore Di Giacinto
58f6aab637 feat: move llama to a grpc 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-15 01:19:43 +02:00
Ettore Di Giacinto
b816009db0 feat: add falcon ggllm via grpc client 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-15 01:19:43 +02:00
mudler
dcf35dd25f Fixup custom role encoding 
Signed-off-by: mudler <mudler@localai.io>
 2023-07-09 11:13:19 +02:00
mudler
e70322676c Allow to customize no action behavior 
Signed-off-by: mudler <mudler@localai.io>
 2023-07-09 10:53:46 +02:00
mudler
b3f43ab938 Add a way to disable default action 2023-07-09 10:02:21 +02:00
mudler
bbc4468908 Make functions more compatible with OpenAI specs 2023-07-09 10:02:09 +02:00
mudler
55befe396a Add grammar_json to the request parameters to facilitate JSON generation 2023-07-06 19:08:04 +02:00