Mirror
/
LocalAI
mirror of https://github.com/mudler/LocalAI.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
685 Commits 20 Branches 89 Tags 28 MiB
Commit Graph

685 Commits

Author SHA1 Message Date
Andrew 9843adb4f1
Create .gitattributes to force git clone to keep the LF line endings on .sh files (#838) 2023-07-30 15:27:43 +02:00
Dave 8e8d474ae8
refactor: Remove remaining uses of depreciated package `io/ioutil` (#837) 2023-07-30 11:23:43 +00:00
renovate[bot] 6151ea1c4d
fix(deps): update github.com/tmc/langchaingo digest to 7df4fe5 (#826) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-30 09:49:12 +02:00
renovate[bot] d969025f87
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 8c51308 (#822) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-30 09:48:52 +02:00
ci-robbot [bot] 18e1cb9c92
⬆️ Update nomic-ai/gpt4all (#825) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-30 09:48:30 +02:00
ci-robbot [bot] e7ceb9e8f5
⬆️ Update go-skynet/go-llama.cpp (#824) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-30 09:48:10 +02:00
renovate[bot] 3a4675c8c3
fix(deps): update module github.com/rs/zerolog to v1.30.0 (#836) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-30 09:47:49 +02:00
Dave 5ce0f216cf
Fix: Model Gallery Downloads (#835) 2023-07-30 09:47:22 +02:00
Ettore Di Giacinto 688f150463
fix: symlink libphonemize in the container (#831) 2023-07-29 12:47:34 +02:00
Ettore Di Giacinto 00ccb8d4f1 fix: set default rope freq base to 10000 during model load 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-29 10:40:56 +02:00
Ettore Di Giacinto e70b91aaef tests: set a small context_size 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-29 10:29:47 +02:00
Dave 8b90ac2b1a
1000 -> 10,000 for ropeFreqBase? 
the error message talks about a default of 10k, so setting this to 10k instead of 1k experimentally.
 2023-07-29 02:37:24 -04:00
Ettore Di Giacinto f085baa77d fix: set default rope if not specified 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-29 01:07:16 +02:00
Ettore Di Giacinto fa4de05c14 fix: symlink libphonemize in the container 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-28 19:40:21 +02:00
Ettore Di Giacinto dde12b492b
fix: select function calls if 'name' is set in the request (#827) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-28 01:17:11 +02:00
Ettore Di Giacinto 096d98c3d9
fix: add rope settings during model load, fix CUDA (#821) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-27 21:56:05 +02:00
renovate[bot] 147cae9ed8
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 39acbc8 (#817) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-27 18:56:59 +02:00
renovate[bot] c63709014b
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6ba16de (#820) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-27 18:56:39 +02:00
Wendy Liga 9b307799ce
fix missing openai_api_base on langchain-chroma example (#818) 2023-07-27 18:41:53 +02:00
renovate[bot] 78e36779cf
fix(deps): update module google.golang.org/grpc to v1.57.0 (#815) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-27 18:41:29 +02:00
ci-robbot [bot] 90ae35e2e4
⬆️ Update nomic-ai/gpt4all (#814) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-27 18:41:15 +02:00
Ettore Di Giacinto b96e30e66c
fix: use bytes in gRPC proto instead of strings (#813) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-27 18:41:04 +02:00
renovate[bot] 0af0df7423
fix(deps): update module github.com/sashabaranov/go-openai to v1.14.1 (#783) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-27 18:40:50 +02:00
renovate[bot] 0883d324d9
fix(deps): update github.com/go-skynet/go-llama.cpp digest to 562d2b5 (#766) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-26 22:06:05 +02:00
renovate[bot] 77597e6a16
fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 9100b2e (#753) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-26 22:05:55 +02:00
renovate[bot] eae6b36d03
fix(deps): update github.com/donomii/go-rwkv.cpp digest to c898cd0 (#748) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-26 22:05:42 +02:00
renovate[bot] c4bc7c41b1
fix(deps): update github.com/tmc/langchaingo digest to 7d5f9fd (#768) 
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
 2023-07-26 22:05:32 +02:00
ci-robbot [bot] c79ddd6fc4
⬆️ Update nomic-ai/gpt4all (#807) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-25 23:03:02 +02:00
Dave ae58fb8821
fix: update gitignore and make clean (#798) 
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2023-07-25 23:02:46 +02:00
Ettore Di Giacinto 569c1d1163
feat: add rope settings and negative prompt, drop grammar backend (#797) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-25 19:05:27 +02:00
Aman Gupta Karmani 12fe0932c4
feat: cancel stream generation if client disappears (#792) 2023-07-24 23:10:54 +02:00
finger42 72e3e236de
Added CPU information to entrypoint.sh (#794) 2023-07-23 19:27:55 +00:00
Ettore Di Giacinto ab59b238b3
fix: update README 2023-07-23 18:58:24 +02:00
ci-robbot [bot] bed9570e48
⬆️ Update nomic-ai/gpt4all (#785) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-23 09:51:42 +02:00
Dave c6bf67f446
feat(llama2): add template for chat messages (#782) 
Co-authored-by: Aman Karmani <aman@tmm1.net>

Lays some of the groundwork for LLAMA2 compatibility as well as other future models with complex prompting schemes.

Started small refactoring in pkg/model/loader.go regarding template loading. Currently still a part of ModelLoader, but should be easy to add template loading for situations other than overall prompt templates and the new chat-specific per-message templates
Adds support for new chat-endpoint-specific, per-message templates as an alternative to the existing Role: XYZ sprintf method.
Includes a temporary prompt template as an example, since I have a few questions before we merge in the model-gallery side changes (see )
Minor debug logging changes.
 2023-07-22 11:31:39 -04:00
ci-robbot [bot] 5ee186b8e5
⬆️ Update go-skynet/go-llama.cpp (#723) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-22 00:55:33 +02:00
Ettore Di Giacinto 94817b557c
fix: make completions endpoint more close to OpenAI specification (#790) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-22 00:53:52 +02:00
Ettore Di Giacinto 26e1496075
Update README.md 2023-07-21 23:10:02 +02:00
Ettore Di Giacinto 92fca8ae74 ci: release space before build 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-21 22:56:43 +02:00
Stepan 7fa5b8401d
[Telegram-bot example] Fix lint for command docker-compose (#787) 
Co-authored-by: Stepan Zhashkov <steven.z@spectral-team.com>
 2023-07-21 20:56:04 +02:00
Ettore Di Giacinto 0eac0402e1
feat: backends improvements (#778) 2023-07-21 20:55:49 +02:00
Ettore Di Giacinto c71c729bc2 debug 2023-07-21 10:53:26 +02:00
Ettore Di Giacinto e459f114cd fix: fix tests, small refactors 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 23:52:04 +02:00
Ettore Di Giacinto 982a7e86a8 feat: add huggingface embeddings backend 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 22:10:42 +02:00
Ettore Di Giacinto 94916749c5 feat: add external grpc and model autoloading 2023-07-20 22:10:12 +02:00
Ettore Di Giacinto 5ce5f87a26
fix: move metal file to grpcs assets (#777) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 22:00:07 +02:00
Ettore Di Giacinto 1d2ae46ddc tests: clean up logs 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 01:36:34 +02:00
ci-robbot [bot] 71ac331f90
⬆️ Update nomic-ai/gpt4all (#775) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2023-07-20 01:22:44 +02:00
Ettore Di Giacinto 47cc95fc9f feat: add all backends to autoload 
Now since gRPCs are not crashing the main thread we can just greedly
attempt all the backends we have available.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 00:40:28 +02:00
Ettore Di Giacinto 3feb632eb4
refactor: rename "llama-master" and "llama" (#776) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-20 00:36:16 +02:00