Ettore Di Giacinto
06cd9ef98d
feat(extra-backends): Improvements, adding mamba example ( #1618 )
...
* feat(extra-backends): Improvements
vllm: add max_tokens, wire up stream event
mamba: fixups, adding examples for mamba-chat
* examples(mamba-chat): add
* docs: update
2024-01-20 17:56:08 +01:00
James Braza
b7127c2dc9
Expanded and interlinked Docker documentation ( #1614 )
...
* Corrected dockerhub to Docker Hub
* Consolidated two Docker examples
* Linked Container Images in Manual Images
2024-01-20 10:05:14 +01:00
Ettore Di Giacinto
ee42c9bfe6
docs: re-use original permalinks ( #1610 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-01-19 19:23:58 +01:00
Ettore Di Giacinto
e6c3e483a1
Update build.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2024-01-19 19:09:35 +01:00
Ettore Di Giacinto
34f9f20ff4
Update quickstart.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2024-01-18 20:49:04 +01:00
Ettore Di Giacinto
a4a72a79ae
Update integrations.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2024-01-18 19:53:41 +01:00
Ettore Di Giacinto
6ca4d38a01
docs/examples: enhancements ( #1572 )
...
* docs: re-order sections
* fix references
* Add mixtral-instruct, tinyllama-chat, dolphin-2.5-mixtral-8x7b
* Fix link
* Minor corrections
* fix: models is a StringSlice, not a String
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* WIP: switch docs theme
* content
* Fix GH link
* enhancements
* enhancements
* Fixed how to link
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* fixups
* logo fix
* more fixups
* final touches
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
Co-authored-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
2024-01-18 19:41:08 +01:00
Dionysius
6f447e613d
docs: missing golang requirement for local build for debian ( #1596 )
...
docs: fix missing golang requirement for local build for debian
2024-01-17 09:26:43 +01:00
lunamidori5
1cca449726
Moving the how tos to self hosted ( #1574 )
...
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/easy-setup-sd.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/easy-setup-full.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/easy-setup-embeddings.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/easy-setup-docker.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update README.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos directory
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
---------
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
2024-01-11 09:25:18 +01:00
Ettore Di Giacinto
08b90b4720
Update _index.en.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2024-01-09 08:50:19 +01:00
Ettore Di Giacinto
e19d7226f8
feat: more embedded models, coqui fixes, add model usage and description ( #1556 )
...
* feat: add model descriptions and usage
* remove default model gallery
* models: add embeddings and tts
* docs: update table
* docs: updates
* images: cleanup pip cache after install
* images: always run apt-get clean
* ux: improve gRPC connection errors
* ux: improve some messages
* fix: fix coqui when no AudioPath is passed by
* embedded: add more models
* Add usage
* Reorder table
2024-01-08 00:37:02 +01:00
Ettore Di Giacinto
ce724a7e55
docs: improve getting started ( #1553 )
...
* docs: improve getting started
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
* cleanups
* Use dockerhub links
* Shrink command to minimum
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2024-01-06 01:04:14 +01:00
Ettore Di Giacinto
09e5d9007b
feat: embedded model configurations, add popular model examples, refactoring ( #1532 )
...
* move downloader out
* separate startup functions for preloading configuration files
* docs: add popular model examples
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* shorteners
* Add llava
* Add mistral-openorca
* Better link to build section
* docs: update
* fixup
* Drop code dups
* Minor fixups
* Apply suggestions from code review
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
* ci: try to cache gRPC build during tests
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* ci: do not build all images for tests, just necessary
* ci: cache gRPC also in release pipeline
* fixes
* Update model_preload_test.go
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2024-01-05 23:16:33 +01:00
Ettore Di Giacinto
db926896bd
Revert "[Refactor]: Core/API Split" ( #1550 )
...
Revert "[Refactor]: Core/API Split (#1506 )"
This reverts commit ab7b4d5ee9
2024-01-05 18:04:46 +01:00
Dave
ab7b4d5ee9
[Refactor]: Core/API Split ( #1506 )
...
Refactors api folder to core, creates firm split between backend code and api frontend.
2024-01-05 15:34:56 +01:00
Ettore Di Giacinto
66fa4f1767
feat: share models by url ( #1522 )
...
* feat: allow to pass by models via args
* expose it also as an env/arg
* docs: enhancements to build/requirements
* do not display status always
* print download status
* not all mesages are debug
2024-01-01 10:31:03 +01:00
Ettore Di Giacinto
d6565f3b99
Update _index.en.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-12-31 10:58:22 +01:00
Ettore Di Giacinto
95eb72bfd3
feat: add 🐸 coqui ( #1489 )
...
* feat: add coqui
* docs: update news
2023-12-24 19:38:54 +01:00
Ettore Di Giacinto
4b520c3343
docs: add langchain4j integration ( #1476 )
...
* docs: add langchain4j integration
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
* Update docs/content/integrations/langchain4j.md
Co-authored-by: LangChain4j <langchain4j@gmail.com>
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update langchain4j.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
Co-authored-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
Co-authored-by: LangChain4j <langchain4j@gmail.com>
2023-12-23 09:13:56 +00:00
lunamidori5
17dde75107
How To (Updates and Fixes) ( #1456 )
...
* Update easy-setup-embeddings.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update and rename easy-setup-docker-cpu.md to easy-setup-docker.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-sd.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-sd.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
---------
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
2023-12-18 18:59:08 +01:00
Ettore Di Giacinto
2eeed2287b
docs: automatically track latest versions ( #1451 )
2023-12-17 19:02:13 +01:00
Ettore Di Giacinto
3d83128f16
feat(alias): alias llama to llama-cpp, update docs ( #1448 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-12-16 18:22:45 +01:00
Ettore Di Giacinto
dd982acf2c
feat(img2vid,txt2vid): Initial support for img2vid,txt2vid ( #1442 )
...
* feat(img2vid): Initial support for img2vid
* doc(SD): fix SDXL Example
* Minor fixups for img2vid
* docs(img2img): fix example curl call
* feat(txt2vid): initial support
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
* diffusers: be retro-compatible with CUDA settings
* docs(img2vid, txt2vid): examples
* Add notice on docs
---------
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-12-15 18:06:20 -05:00
Sertaç Özercan
1b7ed5e2e6
docs: add aikit to integrations ( #1412 )
...
* docs: add aikit to integrations
Signed-off-by: Sertac Ozercan <sozercan@gmail.com>
* docs: add to readme
Signed-off-by: Sertac Ozercan <sozercan@gmail.com>
---------
Signed-off-by: Sertac Ozercan <sozercan@gmail.com>
Co-authored-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
2023-12-12 18:58:57 +01:00
Samuel Walker
865e523ff1
Documentation for Hipblas ( #1425 )
...
hiplas arch
2023-12-12 15:05:01 +01:00
Ettore Di Giacinto
e80cbca6b0
Update _index.en.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-12-12 00:37:01 +01:00
lunamidori5
9222bec8b1
How To Updates / Model Used Switched / Removed "docker-compose" (RIP) ( #1417 )
...
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
---------
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
2023-12-11 14:27:29 +00:00
Ettore Di Giacinto
3a4fb6fa4b
feat(entrypoint): optionally prepare extra endpoints ( #1405 )
...
entrypoint: optionally prepare extra endpoints
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-12-08 20:04:13 +01:00
Ettore Di Giacinto
b181503c30
docs: update v2.0.0 notes
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-12-08 16:06:24 +01:00
Ettore Di Giacinto
887b3dff04
feat: cuda transformers ( #1401 )
...
* Use cuda in transformers if available
tensorflow probably needs a different check.
Signed-off-by: Erich Schubert <kno10@users.noreply.github.com>
* feat: expose CUDA at top level
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* tests: add to tests and create workflow for py extra backends
* doc: update note on how to use core images
---------
Signed-off-by: Erich Schubert <kno10@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Erich Schubert <kno10@users.noreply.github.com>
2023-12-08 15:45:04 +01:00
Ettore Di Giacinto
3822bd2369
docs: updates
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-12-08 15:11:44 +01:00
Ettore Di Giacinto
4de2c6a421
docs: update news
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-12-08 14:59:25 +01:00
Ettore Di Giacinto
6c4231fd35
docs: 2.0 updates
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-12-08 14:58:53 +01:00
lunamidori5
adfa7aa1fa
docs: site update fixing old image text / How To update updating GPU and CPU docker pages ( #1399 )
...
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
---------
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
2023-12-08 10:27:21 +01:00
Dave
8b6e601405
Feat: new backend: transformers-musicgen ( #1387 )
...
Transformers-MusicGen
---------
Signed-off-by: Dave <dave@gray101.com>
2023-12-08 10:01:02 +01:00
Ettore Di Giacinto
238fec244a
fix(vall-e-x): correctly install reqs in environment ( #1377 )
2023-12-03 21:16:36 +01:00
Ettore Di Giacinto
6e408137ee
Update fine-tuning.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-12-02 08:54:21 +01:00
Ettore Di Giacinto
9b205cfcfc
Update fine-tuning.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2023-12-02 08:52:00 +01:00
lunamidori5
6b312a8522
Site Clean up - How to Clean up ( #1342 )
...
* Create easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-request-curl.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-request-openai-v0.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-request-openai-v1.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-request.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/easy-request-openai-v1.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/easy-request-openai-v0.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/easy-request-curl.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update and rename easy-model-import-downloaded.md to easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-gpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-setup-docker-cpu.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/autogen-setup.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Delete docs/content/howtos/easy-request-autogen.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update easy-model.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.en.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* Update _index.md
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
---------
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
2023-12-01 19:12:21 +01:00
Ettore Di Giacinto
2b2007ae9e
docs: add fine-tuning example ( #1374 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-12-01 19:11:45 +01:00
B4ckslash
2d64d8b444
fix/docs: Python backend dependencies ( #1360 )
...
* Update docs for new requirements.txt path
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com>
* Fix typo (.PONY -> .PHONY) in python backend makefiles
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com>
---------
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com>
2023-11-30 17:46:55 +01:00
Ettore Di Giacinto
9b98be160a
ci: limit concurrent jobs ( #1364 )
...
* ci: limit concurrent image push
* docs: mention core images
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-11-30 17:45:20 +01:00
Ettore Di Giacinto
4e0ad33d92
docs: Update getting started and GPU section ( #1362 )
2023-11-29 18:51:57 +01:00
Ettore Di Giacinto
fd1b7b3f22
docs: Add docker instructions, add community projects section in README ( #1359 )
...
docs: Add docker instructions
2023-11-28 23:14:16 +01:00
B4ckslash
5a6a6de3d7
docs: Update Features->Embeddings page to reflect backend restructuring ( #1325 )
...
* Update path to sentencetransformers backend for local execution
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com>
* Rename huggingface-embeddings -> sentencetransformers in embeddings.md for consistency with the backend structure
The Dockerfile still knows the "huggingface-embeddings"
backend (I assume for compatibility reasons) but uses the
sentencetransformers backend under the hood anyway.
I figured it would be good to update the docs to use the new naming to
make it less confusing moving forward. As the docker container knows
both the "huggingface-embeddings" and the "sentencetransformers"
backend, this should not break anything.
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com>
---------
Signed-off-by: Marcus Köhler <khler.marcus@gmail.com>
2023-11-24 18:21:04 +01:00
Ettore Di Giacinto
ba5ab26f2e
docs: Add llava, update hot topics ( #1322 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-11-23 18:54:55 +01:00
Ettore Di Giacinto
c5c77d2b0d
docs: Initial import from localai-website ( #1312 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2023-11-22 18:13:50 +01:00
