You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Marc R Kellerman
325bc78acc
|
2 years ago | |
---|---|---|
.. | ||
README.md | 2 years ago | |
docker-compose.yaml | 2 years ago |
README.md
chatbot-ui
Setup
- Set the
services > api > volumes
parameter in the docker-compose.yaml file. This should point to your local folder with your models. - Copy/Rename your model file to
gpt-3.5-turbo
(without any .bin file extension). - Type
docker compose up
to run the api and the Web UI. - Open http://localhost:3000 for the Web UI.
Known issues
- Can't select the model from the UI. Seems hardcoded to
gpt-3.5-turbo
. - If your machine is slow, the UI will timeout on the request to the API.