🤖 Self-hosted, community-driven, local OpenAI-compatible API with Keycloak Auth Flak app as frontend. 🏠
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
|
name: gpt-3.5-turbo
|
|
parameters:
|
|
model: rwkv
|
|
top_k: 80
|
|
temperature: 0.9
|
|
max_tokens: 100
|
|
top_p: 0.8
|
|
context_size: 1024
|
|
threads: 14
|
|
backend: "rwkv"
|
|
cutwords:
|
|
- "Bob:.*"
|
|
roles:
|
|
user: "Bob:"
|
|
system: "Alice:"
|
|
assistant: "Alice:"
|
|
template:
|
|
completion: rwkv_completion
|
|
chat: rwkv_chat |
