🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, llama2, rwkv, whisper, vicuna, koala, cerebras, falcon, dolly, starcoder, and many others
Go to file
Ettore Di Giacinto 284ad026b1
refactor(routes): split routes registration (#2077)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-04-21 01:19:57 +02:00
.github fix: action-tmate: use connect-timeout-sections and limit-access-to-actor (#2083) 2024-04-20 08:42:02 +00:00
.vscode feat: first pass at improving logging (#1956) 2024-04-04 09:24:22 +02:00
aio models(llama3): add llama3 to embedded models (#2074) 2024-04-19 18:23:44 +02:00
backend Add tensor_parallel_size setting to vllm setting items (#2085) 2024-04-20 14:37:02 +00:00
configuration refactor: move remaining api packages to core (#1731) 2024-03-01 16:19:53 +01:00
core refactor(routes): split routes registration (#2077) 2024-04-21 01:19:57 +02:00
custom-ca-certs feat(certificates): add support for custom CA certificates (#880) 2023-11-01 20:10:14 +01:00
docs feat: enable polling configs for systems with broken fsnotify (docker volumes on windows) (#2081) 2024-04-19 19:31:15 -05:00
embedded models(llama3): add llama3 to embedded models (#2074) 2024-04-19 18:23:44 +02:00
examples build(deps): bump aiohttp from 3.9.2 to 3.9.4 in /examples/langchain/langchainpy-localai-example in the pip group across 1 directory (#2067) 2024-04-18 17:17:33 +00:00
gallery models(gallery): add gallery (#2078) 2024-04-20 15:22:54 +02:00
internal feat: cleanups, small enhancements 2023-07-04 18:58:19 +02:00
models Add docker-compose 2023-04-13 01:13:14 +02:00
pkg models(llama3): add llama3 to embedded models (#2074) 2024-04-19 18:23:44 +02:00
prompt-templates Requested Changes from GPT4ALL to Luna-AI-Llama2 (#1092) 2023-09-22 11:22:17 +02:00
swagger fix(swagger): do not specify a host (#1930) 2024-03-30 12:04:41 +01:00
tests fix(seed): generate random seed per-request if -1 is set (#1952) 2024-04-03 22:25:47 +02:00
.dockerignore fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
.editorconfig feat(stores): Vector store backend (#1795) 2024-03-22 21:14:04 +01:00
.env feat: kong cli refactor fixes #1955 (#1974) 2024-04-11 09:19:24 +02:00
.gitattributes Create .gitattributes to force git clone to keep the LF line endings on .sh files (#838) 2023-07-30 15:27:43 +02:00
.gitignore fix: dont commit generated files to git (#1993) 2024-04-13 09:37:32 +02:00
.gitmodules docs/examples: enhancements (#1572) 2024-01-18 19:41:08 +01:00
CONTRIBUTING.md Update CONTRIBUTING.md 2024-04-12 15:27:40 +02:00
Dockerfile feat: better control of GRPC docker cache (#2070) 2024-04-18 16:19:36 -04:00
Dockerfile.aio feat(aio): entrypoint, update workflows (#1872) 2024-03-21 22:09:04 +01:00
Earthfile Rename project to LocalAI (#35) 2023-04-19 18:43:10 +02:00
Entitlements.plist Feat: OSX Local Codesigning (#1319) 2023-11-23 15:22:54 +01:00
LICENSE docs/examples: enhancements (#1572) 2024-01-18 19:41:08 +01:00
Makefile refactor(routes): split routes registration (#2077) 2024-04-21 01:19:57 +02:00
README.md Update README.md 2024-04-13 19:12:54 +02:00
SECURITY.md Create SECURITY.md 2024-02-29 19:53:04 +01:00
assets.go feat: Update gpt4all, support multiple implementations in runtime (#472) 2023-06-01 23:38:52 +02:00
docker-compose.yaml fix(docker-compose): update docker compose file (#1824) 2024-03-13 17:57:45 +01:00
entrypoint.sh fix: use exec in entrypoint scripts to fix signal handling (#1943) 2024-04-02 09:15:44 +02:00
go.mod feat: fiber logs with zerlog and add trace level (#2082) 2024-04-20 10:43:37 +02:00
go.sum feat: fiber logs with zerlog and add trace level (#2082) 2024-04-20 10:43:37 +02:00
main.go models(gallery): add gallery (#2078) 2024-04-20 15:22:54 +02:00
renovate.json ci: manually update deps 2023-05-04 15:01:29 +02:00

README.md



LocalAI

LocalAI forks LocalAI stars LocalAI pull-requests

LocalAI Docker hub LocalAI Quay.io

Follow LocalAI_API Join LocalAI Discord Community

💡 Get help - FAQ 💭Discussions 💬 Discord 📖 Documentation website

💻 Quickstart 📣 News 🛫 Examples 🖼️ Models 🚀 Roadmap

testsBuild and Releasebuild container imagesBump dependenciesArtifact Hub

LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API thats compatible with OpenAI (Elevenlabs, Anthropic... ) API specifications for local AI inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU.

🔥🔥 Hot topics / Roadmap

Roadmap

Hot topics (looking for contributors):

If you want to help and contribute, issues up for grabs: https://github.com/mudler/LocalAI/issues?q=is%3Aissue+is%3Aopen+label%3A%22up+for+grabs%22

💻 Getting started

For a detailed step-by-step introduction, refer to the Getting Started guide.

For those in a hurry, here's a straightforward one-liner to launch a LocalAI AIO(All-in-one) Image using docker:

docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-aio-cpu
# or, if you have an Nvidia GPU:
# docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-aio-gpu-nvidia-cuda-12

🚀 Features

💻 Usage

Check out the Getting started section in our documentation.

🔗 Community and integrations

Build and deploy custom containers:

WebUIs:

Model galleries

Other:

🔗 Resources

📖 🎥 Media, Blogs, Social

Citation

If you utilize this repository, data in a downstream project, please consider citing it with:

@misc{localai,
  author = {Ettore Di Giacinto},
  title = {LocalAI: The free, Open source OpenAI alternative},
  year = {2023},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/go-skynet/LocalAI}},

❤️ Sponsors

Do you find LocalAI useful?

Support the project by becoming a backer or sponsor. Your logo will show up here with a link to your website.

A huge thank you to our generous sponsors who support this project:

Spectro Cloud logo_600x600px_transparent bg
Spectro Cloud
Spectro Cloud kindly supports LocalAI by providing GPU and computing resources to run tests on lamdalabs!

And a huge shout-out to individuals sponsoring the project by donating hardware or backing the project.

🌟 Star history

LocalAI Star history Chart

📖 License

LocalAI is a community-driven project created by Ettore Di Giacinto.

MIT - Author Ettore Di Giacinto

🙇 Acknowledgements

LocalAI couldn't have been built without the help of great software already available from the community. Thank you!

🤗 Contributors

This is a community project, a special thanks to our contributors! 🤗