mirror of
https://github.com/mudler/LocalAI.git
synced 2024-06-07 19:40:48 +00:00
31 lines
1014 B
Markdown
31 lines
1014 B
Markdown
|
# langchain
|
||
|
|
|
||
|
|
Example of using langchain in TypeScript, with the standard OpenAI llm module, and LocalAI.
|
||
|
|
|
||
|
|
Example for python langchain to follow at a later date
|
||
|
|
|
||
|
|
Set up to make it easy to modify the `index.mts` file to look like any langchain example file.
|
||
|
|
|
||
|
|
**Please Note** - This is a tech demo example at this time. ggml-gpt4all-j has pretty terrible results for most langchain applications with the settings used in this example.
|
||
|
|
|
||
|
|
## Setup
|
||
|
|
|
||
|
|
```bash
|
||
|
|
# Clone LocalAI
|
||
|
|
git clone https://github.com/go-skynet/LocalAI
|
||
|
|
|
||
|
|
cd LocalAI/examples/langchain
|
||
|
|
|
||
|
|
# (optional) - Edit the example code in typescript.
|
||
|
|
# vi ./langchainjs-localai-example/index.ts
|
||
|
|
|
||
|
|
# Download gpt4all-j to models/
|
||
|
|
wget https://gpt4all.io/models/ggml-gpt4all-j.bin -O models/ggml-gpt4all-j
|
||
|
|
|
||
|
|
# start with docker-compose
|
||
|
|
docker-compose up --build
|
||
|
|
```
|
||
|
|
|
||
|
|
## Copyright
|
||
|
|
|
||
|
|
Some of the example code in index.mts is adapted from the langchainjs project and is Copyright (c) Harrison Chase. Used under the terms of the MIT license, as is the remainder of this code.
|