Mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2024-06-07 19:40:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
217dbb448e
LocalAI/examples/langchain
History
Ettore Di Giacinto ed5df1e68e
examples: remove threads from example models (#337)
2023-05-21 12:25:24 +02:00
..
langchainjs-localai-example Langchain Example Updates (#199) 2023-05-06 00:21:06 +02:00
langchainpy-localai-example Langchain Example Updates (#199) 2023-05-06 00:21:06 +02:00
models examples: remove threads from example models (#337) 2023-05-21 12:25:24 +02:00
.gitignore
docker-compose.yaml Dockerized Langchain / PY example (#175) 2023-05-04 08:41:13 +02:00
JS.Dockerfile
PY.Dockerfile Langchain Example Updates (#199) 2023-05-06 00:21:06 +02:00
README.md Langchain Example Updates (#199) 2023-05-06 00:21:06 +02:00

README.md

langchain

Example of using langchain, with the standard OpenAI llm module, and LocalAI. Has docker compose profiles for both the Typescript and Python versions.

Please Note - This is a tech demo example at this time. ggml-gpt4all-j has pretty terrible results for most langchain applications with the settings used in this example.

Setup

# Clone LocalAI
git clone https://github.com/go-skynet/LocalAI

cd LocalAI/examples/langchain

# (optional) - Edit the example code in typescript.
# vi ./langchainjs-localai-example/index.ts

# Download gpt4all-j to models/
wget https://gpt4all.io/models/ggml-gpt4all-j.bin -O models/ggml-gpt4all-j

# start with docker-compose for typescript!
docker-compose --profile ts up --build

# or start with docker-compose for python!
docker-compose --profile py up --build

Copyright

Some of the example code in index.mts and full_demo.py is adapted from the langchainjs project and is Copyright (c) Harrison Chase. Used under the terms of the MIT license, as is the remainder of this code.