🤖 Self-hosted, community-driven, local OpenAI-compatible API with Keycloak Auth Flak app as frontend. 🏠
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
|
name: gpt-3.5-turbo
|
|
parameters:
|
|
model: ggml-gpt4all-j # ggml-koala-13B-4bit-128g
|
|
top_k: 80
|
|
temperature: 0.2
|
|
top_p: 0.7
|
|
context_size: 1024
|
|
threads: 4
|
|
stopwords:
|
|
- "HUMAN:"
|
|
- "GPT:"
|
|
roles:
|
|
user: " "
|
|
system: " "
|
|
backend: "gptj"
|
|
template:
|
|
completion: completion
|
|
chat: completion # gpt4all |
