FlaskAI

🤖 Self-hosted, community-driven, local OpenAI-compatible API with Keycloak Auth Flak app as frontend. 🏠

History

mudler 6ed7b10273 examples: add langchain agent example		1 year ago
..
README.md	examples: add langchain agent example	1 year ago
agent.py	examples: add langchain agent example	1 year ago
docker-compose.yaml	Return usage in the API responses (#166 )	1 year ago
models	Return usage in the API responses (#166 )	1 year ago
test.py	Return usage in the API responses (#166 )	1 year ago

README.md

Langchain-python

Langchain example from quickstart.

To interact with langchain, you can just set the OPENAI_API_BASE URL and provide a token with a random string.

See the example below:

# Clone LocalAI
git clone https://github.com/go-skynet/LocalAI

cd LocalAI/examples/langchain-python

# (optional) Checkout a specific LocalAI tag
# git checkout -b build <TAG>

# Download gpt4all-j to models/
wget https://gpt4all.io/models/ggml-gpt4all-j.bin -O models/ggml-gpt4all-j

# start with docker-compose
docker-compose up -d --build


pip install langchain
pip install openai

export OPENAI_API_BASE=http://localhost:8080
export OPENAI_API_KEY=sk-

python test.py
# A good company name for a company that makes colorful socks would be "Colorsocks".

python agent.py