🤖 Self-hosted, community-driven, local OpenAI-compatible API with Keycloak Auth Flak app as frontend. 🏠
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
FlaskAI/examples/chatbot-ui
Marc R Kellerman 325bc78acc add chatbot-ui example 2 years ago
..
README.md add chatbot-ui example 2 years ago
docker-compose.yaml add chatbot-ui example 2 years ago

README.md

chatbot-ui

Setup

  • Set the services > api > volumes parameter in the docker-compose.yaml file. This should point to your local folder with your models.
  • Copy/Rename your model file to gpt-3.5-turbo (without any .bin file extension).
  • Type docker compose up to run the api and the Web UI.
  • Open http://localhost:3000 for the Web UI.

Known issues

  • Can't select the model from the UI. Seems hardcoded to gpt-3.5-turbo.
  • If your machine is slow, the UI will timeout on the request to the API.