Mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-06-07 19:40:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,067 Commits 23 Branches 89 Tags 30 MiB
85e2767dca
Commit Graph

53 Commits

Author SHA1 Message Date
Ettore Di Giacinto
66fa4f1767
feat: share models by url (#1522) 
* feat: allow to pass by models via args

* expose it also as an env/arg

* docs: enhancements to build/requirements

* do not display status always

* print download status

* not all mesages are debug
 2024-01-01 10:31:03 +01:00
Ettore Di Giacinto
c1888a8062
feat(preload): prepare models in galleries (#1515) 
Previously if applying models from the gallery API, we didn't actually
allowed remote URLs as models as nothing was actually downloading the
models referenced in the configuration file. Now we call Preload after
we have all the models loaded in memory.
 2023-12-30 18:55:18 +01:00
Ettore Di Giacinto
1fc3a375df
feat: inline templates and accept URLs in models (#1452) 
* feat: Allow inline templates

* feat: Allow to specify url in model config files

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

* feat: support 'huggingface://' format

* style: reuse-code from gallery

---------

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2023-12-18 18:58:44 +01:00
Dave
2eb6865a27
Fix: API Key / JSON Fast Follow #1 (#1388) 
fast follow fix #1 - imports, final loop, one last chance to skip

Co-authored-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
 2023-12-05 10:35:27 +00:00
lunamidori5
563c5b7ea0
Added Check API KEYs file to API.go (#1381) 
Added API KEYs file

Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
 2023-12-04 22:06:45 -05:00
Ettore Di Giacinto
824612f1b4
feat: initial watchdog implementation (#1341) 
* feat: initial watchdog implementation

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

* fiuxups

* Add more output

* wip: idletime checker

* wire idle watchdog checks

* enlarge watchdog time window

* small fixes

* Use stopmodel

* Always delete process

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-11-26 18:36:23 +01:00
Jesús Espino
e91f660eb1
feat(metrics): Adding initial support for prometheus metrics (#1176) 
* feat(metrics): Adding initial support for prometheus metrics

* Fixing CI

* run go mod tidy
 2023-10-17 18:22:53 +02:00
Dave
005f289632
feat: Model Gallery Endpoint Refactor / Mutable Galleries Endpoints (#991) 
refactor for model gallery endpoints - bundle up resources into a
struct, make galleries mutable with some crud endpoints. This is
groundwork required for making efficient use of the new scraper - while
that PR isn't _quite_ ready yet, the goal is to have more, individually
smaller gallery files. Therefore, rather than requiring a full localai
service restart, these new endpoints have been added to make life
easier.

- Adds endpoints to add, list and remove model galleries at runtime
- Adds these endpoints to the Insomnia config
- Minor fix: loading file urls follows symbolic links now
 2023-09-02 09:00:44 +02:00
Jirubizu
355e9d4fb5
[API] expose all the jobs via /models/jobs endpoint (#983) 
**Description**

This PR fixes #


**Notes for Reviewers**


**[Signed
commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)**
- [ ] Yes, I signed my commits.
 

<!--
Thank you for contributing to LocalAI! 

Contributing Conventions:

1. Include descriptive PR titles with [<component-name>] prepended.
2. Build and test your changes before submitting a PR. 
3. Sign your commits

By following the community's contribution conventions upfront, the
review process will
be accelerated and your PR merged more quickly.
-->

Co-authored-by: Jirubizu <jirubizu@jirubizu.cc>
 2023-08-31 15:03:03 +00:00
Dave
10b0e13882
feat: backend monitor shutdown endpoint, process based (#938) 
This PR adds a new endpoint to the backend monitor section
`/backend/shutdown` which terminates the grpc process for the related
model.
 2023-08-23 18:38:37 +02:00
Ettore Di Giacinto
cc060a283d
fix: drop racy code, refactor and group API schema (#931) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-08-20 14:04:45 +02:00
Dave
8cb1061c11
Usage Features (#863) 2023-08-18 21:23:14 +02:00
Michael Nesbitt
1d1cae8e4d
feat: add API_KEY list support (#877) 
Co-authored-by: Harold Sun <sunhua@amazon.com>
 2023-08-10 00:06:21 +02:00
Ettore Di Giacinto
1d0ed95a54 feat: move other backends to grpc 
This finally makes everything more consistent

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-15 01:19:43 +02:00
Ettore Di Giacinto
5dcfdbe51d feat: various refactorings 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-15 01:19:43 +02:00
Ettore Di Giacinto
b816009db0 feat: add falcon ggllm via grpc client 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2023-07-15 01:19:43 +02:00
mudler
b722e7eb7e feat: cleanups, small enhancements 
Signed-off-by: mudler <mudler@localai.io>
 2023-07-04 18:58:19 +02:00
Ettore Di Giacinto
d3a486a4f8
feat: Add '/version' endpoint and display it in the CLI (#679) 2023-06-26 15:12:43 +02:00
Ettore Di Giacinto
2b957df56c
fix: rename /models/list to /models/available (#678) 2023-06-26 15:12:26 +02:00
Ettore Di Giacinto
78f3c3da48
refactor: consolidate usage of GetURI (#674) 
Signed-off-by: mudler <mudler@localai.io>
 2023-06-26 12:25:38 +02:00
Ettore Di Giacinto
60db5957d3
Gallery repository (#663) 
Signed-off-by: mudler <mudler@localai.io>
 2023-06-24 08:18:17 +02:00
Ettore Di Giacinto
a7bb029d23
feat: add tts with go-piper (#649) 
Signed-off-by: mudler <mudler@localai.io>
 2023-06-22 17:53:10 +02:00
Ettore Di Giacinto
e37361985c
deps: update gpt4all bindings, fix search path on new versions (#592) 2023-06-14 13:24:53 +02:00
Ettore Di Giacinto
78ad4813df
feat: Update gpt4all, support multiple implementations in runtime (#472) 
Signed-off-by: mudler <mudler@mocaccino.org>
 2023-06-01 23:38:52 +02:00
Ettore Di Giacinto
aacb96df7a
fix: correctly handle errors from App constructor (#430) 
Signed-off-by: mudler <mudler@mocaccino.org>
 2023-05-30 12:00:30 +02:00
Ettore Di Giacinto
76c881043e
feat: allow to preload models before startup via env var or configs (#391) 2023-05-27 09:26:33 +02:00
Ettore Di Giacinto
bf54b78270
feat: add /healthz and /readyz endpoints for kubernetes (#374) 2023-05-24 22:19:13 +02:00
Ettore Di Giacinto
6f54cab3f0
feat: allow to set cors (#339) 2023-05-21 14:38:25 +02:00
Ettore Di Giacinto
05a3d569b0
feat: allow to override model config (#323) 2023-05-20 17:03:53 +02:00
Ettore Di Giacinto
cc9aa9eb3f
feat: add /models/apply endpoint to prepare models (#286) 2023-05-18 15:59:03 +02:00
Ettore Di Giacinto
9d051c5d4f
feat: add image generation with ncnn-stablediffusion (#272) 2023-05-16 19:32:53 +02:00
Ettore Di Giacinto
fd1df4e971
whisper: add tests and allow to set upload size (#237) 2023-05-12 10:04:20 +02:00
Ettore Di Giacinto
9f426578cf
feat: add transcript endpoint (#211) 2023-05-09 11:43:50 +02:00
mudler
e96eadab40 feat: support deprecated embeddings API 2023-05-05 15:55:19 +02:00
mudler
857d13e8d6 debug: wire up go-fiber debugger 2023-05-05 15:53:57 +02:00
Ettore Di Giacinto
c839b334eb
feat: add embeddings for go-llama.cpp backend (#190) 2023-05-05 11:20:06 +02:00
Ettore Di Giacinto
52f4d993c1
feat: add /edit endpoint (#119) 2023-04-29 09:22:09 +02:00
Ettore Di Giacinto
c806eae0de
feat: config files and SSE (#83) 
Signed-off-by: mudler <mudler@mocaccino.org>
Signed-off-by: Tyler Gillson <tyler.gillson@gmail.com>
Co-authored-by: Tyler Gillson <tyler.gillson@gmail.com>
 2023-04-26 21:18:18 -07:00
Ettore Di Giacinto
12d83a4184
feat: Return OpenAI errors and update docs (#80) 
Signed-off-by: mudler <mudler@mocaccino.org>
 2023-04-24 23:42:03 +02:00
Ettore Di Giacinto
1c872ec326
feat: add CI/tests (#58) 
Signed-off-by: mudler <mudler@mocaccino.org>
 2023-04-22 00:44:52 +02:00
Ettore Di Giacinto
79791438fe
Use the first available model if not specified (#55) 
Signed-off-by: mudler <mudler@mocaccino.org>
 2023-04-21 22:54:43 +02:00
Ettore Di Giacinto
5cba71de70
Add stopwords, debug mode, and other API enhancements (#54) 
Signed-off-by: mudler <mudler@mocaccino.org>
 2023-04-21 19:46:59 +02:00
Ettore Di Giacinto
f816dfae65
Add support for stablelm (#48) 
Signed-off-by: mudler <mudler@mocaccino.org>
 2023-04-21 00:06:55 +02:00
Ettore Di Giacinto
1c4fbaae20
Add support for cerebras (#45) 
Signed-off-by: mudler <mudler@c3os.io>
 2023-04-20 19:33:36 +02:00
Ettore Di Giacinto
d517a54e28
Major API enhancements (#44) 2023-04-20 18:33:02 +02:00
Ettore Di Giacinto
80f50e6ccd
Rename project to LocalAI (#35) 
Signed-off-by: mudler <mudler@c3os.io>
 2023-04-19 18:43:10 +02:00
Ettore Di Giacinto
7fec26f5d3
Enhancements (#34) 
Signed-off-by: mudler <mudler@c3os.io>
 2023-04-19 17:10:29 +02:00
Ettore Di Giacinto
0b330d90ad
feat: drop embedded webui (#27) 
Signed-off-by: mudler <mudler@c3os.io>
 2023-04-16 10:46:20 +02:00
Ettore Di Giacinto
63601fabd1
feat: drop default model and llama-specific API (#26) 
Signed-off-by: mudler <mudler@c3os.io>
 2023-04-16 10:40:50 +02:00
Ettore Di Giacinto
b062f3142b
feat: enhance API, expose more parameters (#24) 
Signed-off-by: mudler <mudler@c3os.io>
 2023-04-16 10:16:48 +02:00