Ettore Di Giacinto
1120847f72
feat: bump llama.cpp, add gguf support ( #943 )
...
**Description**
This PR syncs up the `llama` backend to use `gguf`
(https://github.com/go-skynet/go-llama.cpp/pull/180 ). It also adds
`llama-stable` to the targets so we can still load ggml. It adapts the
current tests to use the `llama-backend` for ggml and uses a `gguf`
model to run tests on the new backend.
In order to consume the new version of go-llama.cpp, it also bump go to
1.21 (images, pipelines, etc)
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-08-24 01:18:58 +02:00
Dave
a9ca70ad4a
infra: add setup-go@4, test against 1.20.x (go.mod) and stable (1.21) ( #935 )
2023-08-21 22:16:47 +02:00
Ettore Di Giacinto
fa4de05c14
fix: symlink libphonemize in the container
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-28 19:40:21 +02:00
Ettore Di Giacinto
569c1d1163
feat: add rope settings and negative prompt, drop grammar backend ( #797 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-25 19:05:27 +02:00
Ettore Di Giacinto
92fca8ae74
ci: release space before build
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-21 22:56:43 +02:00
Ettore Di Giacinto
e459f114cd
fix: fix tests, small refactors
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-20 23:52:04 +02:00
Ettore Di Giacinto
3feb632eb4
refactor: rename "llama-master" and "llama" ( #776 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-20 00:36:16 +02:00
Ettore Di Giacinto
6352448b72
feat: add llama-master backend ( #752 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-17 23:58:15 +02:00
Ettore Di Giacinto
cb5d6f6e3a
ci: track updates for new deps
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-15 10:04:09 +02:00
Ettore Di Giacinto
98e73ed67a
fix: CI fixes
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-15 01:19:43 +02:00
Ettore Di Giacinto
189cb3a7be
feat: run all tests
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-07-15 01:19:43 +02:00
Ettore Di Giacinto
d59211982b
Create FUNDING.yml ( #725 )
2023-07-09 13:39:00 +02:00
Ettore Di Giacinto
d3d3187e51
feat: fix CUDA images and update go-llama to use full GPU offloading ( #618 )
...
Signed-off-by: mudler <mudler@localai.io>
Co-authored-by: mudler <mudler@localai.io>
2023-06-18 08:27:29 +02:00
Ettore Di Giacinto
2880221bb3
ci: drop macOS dependencies ( #581 )
...
Signed-off-by: mudler <mudler@mocaccino.org>
2023-06-13 09:31:11 +02:00
Ettore Di Giacinto
d9130def39
fix: correctly assign ffmpeg image tag ( #499 )
2023-06-04 21:07:12 +02:00
Ettore Di Giacinto
1bb85377e4
feat: add ffmpeg images ( #492 )
...
Signed-off-by: mudler <mudler@mocaccino.org>
2023-06-04 14:00:21 +02:00
Ettore Di Giacinto
8fb86c13bc
feat: Enable static builds for Linux binaries ( #487 )
...
Signed-off-by: mudler <mudler@mocaccino.org>
2023-06-03 23:46:07 +02:00
Sébastien Prud'homme
eee3f83d98
ci: build Docker image variants ( #456 )
...
Signed-off-by: Sébastien Prud'homme <sebastien.prudhomme@gmail.com>
2023-05-31 19:51:02 +02:00
Sébastien Prud'homme
171b50bb1c
ci: fix typo in variable name ( #424 )
...
Signed-off-by: Sébastien Prud'homme <sebastien.prudhomme@gmail.com>
2023-05-29 23:11:29 +02:00
Ettore Di Giacinto
9decd0813c
feat: update go-gpt2 ( #359 )
...
Signed-off-by: mudler <mudler@mocaccino.org>
2023-05-23 21:47:47 +02:00
Ettore Di Giacinto
43d3fb3eba
ci: add binary releases pipelines ( #358 )
2023-05-23 17:12:48 +02:00
Aisuko
d0c033d09b
feat: add PR template and stale configuration ( #316 )
...
Signed-off-by: Aisuko <urakiny@gmail.com>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-05-20 09:10:20 +02:00
Ettore Di Giacinto
aa7a18f131
github: add ISSUE_TEMPLATE ( #307 )
2023-05-19 11:46:53 +02:00
Ettore Di Giacinto
1fade53a61
feat: minor enhancements to /models/apply ( #297 )
2023-05-19 08:31:11 +02:00
Ettore Di Giacinto
3f739575d8
Minor fixes ( #285 )
2023-05-17 21:01:46 +02:00
Ettore Di Giacinto
fd1df4e971
whisper: add tests and allow to set upload size ( #237 )
2023-05-12 10:04:20 +02:00
Ettore Di Giacinto
59e3c02002
make use of new bindings for gpt4all ( #232 )
2023-05-11 14:31:19 +02:00
Ettore Di Giacinto
11675932ac
feat: add dolly/redpajama/bloomz models support ( #214 )
2023-05-11 01:12:58 +02:00
Ettore Di Giacinto
f8ee20991c
feat: add bert.cpp embeddings ( #222 )
2023-05-10 15:20:21 +02:00
Ettore Di Giacinto
9f426578cf
feat: add transcript endpoint ( #211 )
2023-05-09 11:43:50 +02:00
mudler
6352308882
ci: minor fixups
2023-05-04 15:08:20 +02:00
mudler
a8172a0f4e
ci: fix typo
2023-05-04 15:04:41 +02:00
mudler
ebcd10d66f
ci: manually update deps
2023-05-04 15:01:29 +02:00
Ettore Di Giacinto
220d6fd59b
feat: add stream events ( #152 )
2023-05-02 20:03:35 +02:00
renovate[bot]
4e2061636e
chore(deps): update actions/checkout action to v3 ( #82 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-04-25 07:46:29 +02:00
Ettore Di Giacinto
676e15f785
fix: make MacOS builds work ( #61 )
2023-04-22 11:05:23 +02:00
Ettore Di Giacinto
1c872ec326
feat: add CI/tests ( #58 )
...
Signed-off-by: mudler <mudler@mocaccino.org>
2023-04-22 00:44:52 +02:00
Ettore Di Giacinto
80f50e6ccd
Rename project to LocalAI ( #35 )
...
Signed-off-by: mudler <mudler@c3os.io>
2023-04-19 18:43:10 +02:00
mudler
a9cd6b3ca3
ci: Fix tag detection for 'latest'
2023-04-13 01:37:09 +02:00
mudler
a896a2b5ad
Drop armv7 builds
2023-04-13 01:21:40 +02:00
mudler
16f1281d38
Minor workflow fixes
2023-04-13 01:16:13 +02:00
mudler
8042e9a2d6
Add docker-compose
...
Fixes #14
Signed-off-by: mudler <mudler@c3os.io>
2023-04-13 01:13:14 +02:00
mudler
6394d85ca2
Lower conversion parallelism
2023-03-23 19:22:23 +01:00
mudler
2b6a5aef5f
Lower earthly parallelism
2023-03-23 19:17:15 +01:00
mudler
d191ecb9fe
Disable release pipeline
2023-03-23 19:14:39 +01:00
mudler
6ca13f0227
Cleanup workers to have more free space
2023-03-20 10:12:31 +01:00
mudler
8da01d768c
Update Earthly versions
2023-03-20 00:40:32 +01:00
mudler
e764c3225c
Workaround Earthly issue
2023-03-20 00:24:37 +01:00
mudler
291a8a6d2e
Multi-platform Earthly build must be in a target
2023-03-19 23:52:00 +01:00
mudler
896da59b87
Add GitHub action workflows
2023-03-19 23:50:31 +01:00