Mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-06-07 19:40:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
820 Commits 23 Branches 89 Tags 18 MiB
813eaa867c
Commit Graph

820 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ettore Di Giacinto
096d98c3d9
fix: add rope settings during model load, fix CUDA (#821) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-27 21:56:05 +02:00
renovate[bot]
147cae9ed8
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 39acbc8 (#817) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-27 18:56:59 +02:00
renovate[bot]
c63709014b
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6ba16de (#820) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-27 18:56:39 +02:00
Wendy Liga
9b307799ce
fix missing openai_api_base on langchain-chroma example (#818) 2023-07-27 18:41:53 +02:00
renovate[bot]
78e36779cf
fix(deps): update module google.golang.org/grpc to v1.57.0 (#815) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-27 18:41:29 +02:00
ci-robbot [bot]
90ae35e2e4
⬆️ Update nomic-ai/gpt4all (#814) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-27 18:41:15 +02:00
Ettore Di Giacinto
b96e30e66c
fix: use bytes in gRPC proto instead of strings (#813) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-27 18:41:04 +02:00
renovate[bot]
0af0df7423
fix(deps): update module github.com/sashabaranov/go-openai to v1.14.1 (#783) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-27 18:40:50 +02:00
renovate[bot]
0883d324d9
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 562d2b5 (#766) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-26 22:06:05 +02:00
renovate[bot]
77597e6a16
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 9100b2e (#753) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-26 22:05:55 +02:00
renovate[bot]
eae6b36d03
fix(deps): update github.com/donomii/go-rwkv.cpp digest to c898cd0 (#748) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-26 22:05:42 +02:00
renovate[bot]
c4bc7c41b1
fix(deps): update github.com/tmc/langchaingo digest to 7d5f9fd (#768) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-26 22:05:32 +02:00
ci-robbot [bot]
c79ddd6fc4
⬆️ Update nomic-ai/gpt4all (#807) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-25 23:03:02 +02:00
Dave
ae58fb8821
fix: update gitignore and make clean (#798) 
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2023-07-25 23:02:46 +02:00
Ettore Di Giacinto
569c1d1163
feat: add rope settings and negative prompt, drop grammar backend (#797) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-25 19:05:27 +02:00
Aman Gupta Karmani
12fe0932c4
feat: cancel stream generation if client disappears (#792) 2023-07-24 23:10:54 +02:00
finger42
72e3e236de
Added CPU information to entrypoint.sh (#794) 2023-07-23 19:27:55 +00:00
Ettore Di Giacinto
ab59b238b3
fix: update README 2023-07-23 18:58:24 +02:00
ci-robbot [bot]
bed9570e48
⬆️ Update nomic-ai/gpt4all (#785) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-23 09:51:42 +02:00
Dave
c6bf67f446
feat(llama2): add template for chat messages (#782) 
Co-authored-by: Aman Karmani <aman@tmm1.net>

Lays some of the groundwork for LLAMA2 compatibility as well as other future models with complex prompting schemes.

Started small refactoring in pkg/model/loader.go regarding template loading. Currently still a part of ModelLoader, but should be easy to add template loading for situations other than overall prompt templates and the new chat-specific per-message templates
Adds support for new chat-endpoint-specific, per-message templates as an alternative to the existing Role: XYZ sprintf method.
Includes a temporary prompt template as an example, since I have a few questions before we merge in the model-gallery side changes (see )
Minor debug logging changes.
 2023-07-22 11:31:39 -04:00
ci-robbot [bot]
5ee186b8e5
⬆️ Update go-skynet/go-llama.cpp (#723) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-22 00:55:33 +02:00
Ettore Di Giacinto
94817b557c
fix: make completions endpoint more close to OpenAI specification (#790) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-22 00:53:52 +02:00
Ettore Di Giacinto
26e1496075
Update README.md 2023-07-21 23:10:02 +02:00
Ettore Di Giacinto
92fca8ae74 ci: release space before build 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-21 22:56:43 +02:00
Stepan
7fa5b8401d
[Telegram-bot example] Fix lint for command docker-compose (#787) 
Co-authored-by: Stepan Zhashkov <steven.z@spectral-team.com>
 2023-07-21 20:56:04 +02:00
Ettore Di Giacinto
0eac0402e1
feat: backends improvements (#778) 2023-07-21 20:55:49 +02:00
Ettore Di Giacinto
c71c729bc2 debug 2023-07-21 10:53:26 +02:00
Ettore Di Giacinto
e459f114cd fix: fix tests, small refactors 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 23:52:04 +02:00
Ettore Di Giacinto
982a7e86a8 feat: add huggingface embeddings backend 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 22:10:42 +02:00
Ettore Di Giacinto
94916749c5 feat: add external grpc and model autoloading 2023-07-20 22:10:12 +02:00
Ettore Di Giacinto
5ce5f87a26
fix: move metal file to grpcs assets (#777) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 22:00:07 +02:00
Ettore Di Giacinto
1d2ae46ddc tests: clean up logs 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 01:36:34 +02:00
ci-robbot [bot]
71ac331f90
⬆️ Update nomic-ai/gpt4all (#775) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-20 01:22:44 +02:00
Ettore Di Giacinto
47cc95fc9f feat: add all backends to autoload 
Now since gRPCs are not crashing the main thread we can just greedly
attempt all the backends we have available.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 00:40:28 +02:00
Ettore Di Giacinto
3feb632eb4
refactor: rename "llama-master" and "llama" (#776) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 00:36:16 +02:00
Ettore Di Giacinto
236497e331
feat: resolve JSONSchema refs (planners) (#774) 2023-07-19 22:56:13 +02:00
ci-robbot [bot]
a38dc497b2
⬆️ Update go-skynet/go-llama.cpp (#770) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-19 19:44:33 +02:00
ci-robbot [bot]
28ed52fa94
⬆️ Update nomic-ai/gpt4all (#769) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-19 19:44:21 +02:00
Enzo Einhorn
e995b95c94
[build] pass build type to cmake on libtransformers.a build (#741) 
Co-authored-by: Enzo Einhorn <enzo.einhorn@hiventive.com>
 2023-07-18 19:04:19 +02:00
Ettore Di Giacinto
8379cce209
example(functions): Add OpenAI functions example (#767) 2023-07-18 00:04:21 +02:00
ci-robbot [bot]
3c6b798522
⬆️ Update nomic-ai/gpt4all (#759) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-17 23:58:40 +02:00
ci-robbot [bot]
c18770a61a
⬆️ Update go-skynet/go-bert.cpp (#758) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-17 23:58:25 +02:00
Ettore Di Giacinto
6352448b72
feat: add llama-master backend (#752) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-17 23:58:15 +02:00
renovate[bot]
fb6cce487f
fix(deps): update module github.com/gofiber/fiber/v2 to v2.48.0 (#757) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-16 22:02:30 +02:00
renovate[bot]
3079cc4167
fix(deps): update github.com/go-skynet/go-bert.cpp digest to 6abe312 (#756) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-16 22:01:53 +02:00
ci-robbot [bot]
27ef8b1eb7
⬆️ Update go-skynet/go-ggml-transformers.cpp (#711) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-16 09:57:16 +02:00
ci-robbot [bot]
c00435d72b
⬆️ Update nomic-ai/gpt4all (#735) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-16 09:57:00 +02:00
Ettore Di Giacinto
d0e67cce75 fix: make last stream message to send empty content 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-16 00:09:28 +02:00
renovate[bot]
6ec315e540
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6c97625 (#733) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-15 22:53:41 +02:00
renovate[bot]
cf4e6f909c
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cfd70b6 (#734) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-15 22:53:28 +02:00