Mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-06-07 19:40:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,362 Commits 23 Branches 89 Tags 18 MiB
efcca15d3f
Commit Graph

1362 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
LocalAI [bot]
efcca15d3f
⬆️ Update ggerganov/llama.cpp (#1970) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-04-08 08:38:47 +02:00
LocalAI [bot]
a153b628c2
⬆️ Update ggerganov/whisper.cpp (#1969) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-04-08 08:38:17 +02:00
Ettore Di Giacinto
f36d86ba6d
fix(hermes-2-pro-mistral): correct dashes in template to suppress newlines (#1966) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-07 18:23:47 +02:00
Ettore Di Giacinto
74492a81c7
doc(quickstart): fix typo 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-04-07 11:06:35 +02:00
LocalAI [bot]
ed13782986
⬆️ Update ggerganov/llama.cpp (#1964) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-04-07 10:32:10 +02:00
Ettore Di Giacinto
8342553214
fix(llama.cpp): set better defaults for llama.cpp (#1961) 
fix(defaults): set better defaults for llama.cpp

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-06 22:56:45 +02:00
LocalAI [bot]
8aa5f5a660
⬆️ Update ggerganov/llama.cpp (#1960) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-04-06 19:15:25 +00:00
LocalAI [bot]
b2d9e3f704
⬆️ Update ggerganov/llama.cpp (#1959) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-04-05 08:41:55 +02:00
LocalAI [bot]
f744e1f931
⬆️ Update ggerganov/whisper.cpp (#1958) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-04-05 08:41:35 +02:00
cryptk
b85dad0286
feat: first pass at improving logging (#1956) 
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>
 2024-04-04 09:24:22 +02:00
LocalAI [bot]
3851b51d98
⬆️ Update ggerganov/llama.cpp (#1953) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-04-04 00:27:57 +02:00
Ettore Di Giacinto
ff77d3bc22
fix(seed): generate random seed per-request if -1 is set (#1952) 
* fix(seed): generate random seed per-request if -1 is set

Also update ci with new workflows and allow the aio tests to run with an
api key

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* docs(openvino): Add OpenVINO example

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-03 22:25:47 +02:00
Ettore Di Giacinto
93cfec3c32 ci: correctly tag latest and aio images 2024-04-03 11:30:23 +02:00
Ettore Di Giacinto
89560ef87f
fix(ci): manually tag latest images (#1948) 
fix(ci): manually tag images

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-02 19:25:46 +02:00
Ettore Di Giacinto
9bc209ba73
fix(welcome): stable model list (#1949) 2024-04-02 19:25:32 +02:00
Ettore Di Giacinto
84e0dc3246
fix(hermes-2-pro-mistral): correct stopwords (#1947) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-02 15:38:00 +02:00
LocalAI [bot]
4d4d76114d
⬆️ Update ggerganov/llama.cpp (#1941) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-04-02 09:16:04 +02:00
cryptk
86bc5f1350
fix: use exec in entrypoint scripts to fix signal handling (#1943) 2024-04-02 09:15:44 +02:00
Ettore Di Giacinto
e8f02c083f
fix(functions): respect when selected from string (#1940) 
* fix(functions): respect when selected from string

* fix(toolschoice): decode both string and objects
 2024-04-01 19:39:54 +02:00
Ettore Di Giacinto
ebb1fcedea
fix(hermes-2-pro-mistral): add stopword for toolcall (#1939) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-01 11:48:35 +02:00
LocalAI [bot]
66f90f8dc1
⬆️ Update ggerganov/llama.cpp (#1937) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-04-01 08:59:23 +02:00
Ettore Di Giacinto
3c778b538a
Update phi-2-orange.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-03-31 13:06:41 +02:00
Ettore Di Giacinto
35290e146b
fix(grammar): respect JSONmode and grammar from user input (#1935) 
* fix(grammar): Fix JSON mode and custom grammar

* tests(aio): add jsonmode test

* tests(aio): add functioncall test

* fix(aio): use hermes-2-pro-mistral as llm for CPU profile

* add phi-2-orange
 2024-03-31 13:04:09 +02:00
LocalAI [bot]
784657a652
⬆️ Update ggerganov/llama.cpp (#1934) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-03-31 00:27:38 +01:00
LocalAI [bot]
831efa8893
⬆️ Update ggerganov/whisper.cpp (#1933) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-03-31 00:27:16 +01:00
Ettore Di Giacinto
957f428fd5
fix(tools): correctly render tools response in templates (#1932) 
* fix(tools): allow to correctly display both Functions and Tools

* models(hermes-2-pro): correctly display function results
 2024-03-30 19:02:07 +01:00
Ettore Di Giacinto
61e5e6bc36
fix(swagger): do not specify a host (#1930) 
In this way the requests are redirected to the host used by the client
to perform the request.
 2024-03-30 12:04:41 +01:00
Ettore Di Giacinto
eab4a91a9b
fix(aio): correctly detect intel systems (#1931) 
Also rename SIZE to PROFILE
 2024-03-30 12:04:32 +01:00
LocalAI [bot]
2bba62ca4d
⬆️ Update ggerganov/llama.cpp (#1928) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-03-29 22:52:01 +00:00
Ettore Di Giacinto
bcdc83b46d
Update quickstart.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-03-29 23:00:06 +01:00
Ettore Di Giacinto
92fbdfd06f
feat(swagger): update (#1929) 2024-03-29 22:48:58 +01:00
cryptk
93702e39d4
feat(build): adjust number of parallel make jobs (#1915) 
* feat(build): adjust number of parallel make jobs

* fix: update make on MacOS from brew to support --output-sync argument

* fix: cache grpc with version as part of key to improve validity of cache hits

* fix: use gmake for tests-apple to use the updated GNU make version

* fix: actually use the new make version for tests-apple

* feat: parallelize tests-extra

* feat: attempt to cache grpc build for docker images

* fix: don't quote GRPC version

* fix: don't cache go modules, we have limited cache space, better used elsewhere

* fix: release with the same version of go that we test with

* fix: don't fail on exporting cache layers

* fix: remove deprecated BUILD_GRPC docker arg from Makefile
 2024-03-29 22:32:40 +01:00
LocalAI [bot]
a7fc89c207
⬆️ Update ggerganov/whisper.cpp (#1927) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-03-29 22:29:50 +01:00
Ettore Di Giacinto
123a5a2e16
feat(swagger): Add swagger API doc (#1926) 
* makefile(build): add minimal and api build target

* feat(swagger): Add swagger
 2024-03-29 22:29:33 +01:00
LocalAI [bot]
ab2f403dd0
⬆️ Update ggerganov/whisper.cpp (#1924) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-03-29 00:13:59 +01:00
LocalAI [bot]
b9c5e14e2c
⬆️ Update ggerganov/llama.cpp (#1923) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-03-29 00:13:38 +01:00
Ettore Di Giacinto
bf65ed6eb8
feat(webui): add partials, show backends associated to models (#1922) 
* feat(webui): add partials, show backends associated to models

* fix(auth): put assistant and backend under auth
 2024-03-28 21:52:52 +01:00
Ettore Di Giacinto
4e79294f97
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-03-28 19:52:40 +01:00
Ettore Di Giacinto
8477e8fac3
Update quickstart.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-03-28 18:28:30 +01:00
Ettore Di Giacinto
13ccd2afef
docs(aio-usage): update docs to show examples (#1921) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-03-28 18:16:58 +01:00
Ettore Di Giacinto
23b833d171
Update run-other-models.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-03-28 12:42:37 +01:00
LocalAI [bot]
07c49ee4b8
⬆️ Update ggerganov/whisper.cpp (#1914) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-03-27 22:53:13 +00:00
LocalAI [bot]
07c4bdda7c
⬆️ Update ggerganov/llama.cpp (#1913) 
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: mudler <mudler@users.noreply.github.com>
 2024-03-27 21:57:59 +00:00
Ettore Di Giacinto
2266d8263c
Update README.md 2024-03-27 22:48:46 +01:00
Ettore Di Giacinto
160eb48b2b
Update quickstart.md 2024-03-27 22:47:59 +01:00
cryptk
0c0efc871c
fix(build): better CI logging and correct some build failure modes in Makefile (#1899) 
* feat: group make output by target when running parallelized builds in CI

* fix: quote GO_TAGS in makefile to fix handling of whitespace in value

* fix: set CPATH to find opencv2 in it's commonly installed location

* fix: add missing go mod dropreplace for go-llama.cpp

* chore: remove opencv symlink from github workflows
 2024-03-27 21:12:19 +01:00
Gianluca Boiano
7ef5f3b473
⬆️ Update M0Rf30/go-tiny-dream (#1911) 2024-03-27 21:12:04 +01:00
Ettore Di Giacinto
66ee4afb95
feat(welcome): add simple welcome page (#1912) 
* feat(welcome): add simple welcome page

* feat(api): add 404 handling
 2024-03-27 21:10:58 +01:00
Ettore Di Giacinto
93f0b7ae03
update hot topics 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-03-27 18:17:12 +01:00
fakezeta
8210ffcb6c
feat: Token Stream support for Transformer, fix: missing package for OpenVINO (#1908) 
* Streaming working

* Small fix for regression on CUDA and XPU

* use pip version of optimum[openvino]

* Update backend/python/transformers/transformers_server.py

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>

* Token streaming support

fix optimum[openvino] package in install.sh

* Token Streaming support

---------

Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-03-27 17:50:35 +01:00