Ettore Di Giacinto
|
aacb96df7a
|
fix: correctly handle errors from App constructor (#430)
Signed-off-by: mudler <mudler@mocaccino.org>
|
2 years ago |
|
Ettore Di Giacinto
|
76c881043e
|
feat: allow to preload models before startup via env var or configs (#391)
|
2 years ago |
|
Ettore Di Giacinto
|
bf54b78270
|
feat: add /healthz and /readyz endpoints for kubernetes (#374)
|
2 years ago |
|
Ettore Di Giacinto
|
6f54cab3f0
|
feat: allow to set cors (#339)
|
2 years ago |
|
Ettore Di Giacinto
|
05a3d569b0
|
feat: allow to override model config (#323)
|
2 years ago |
|
Ettore Di Giacinto
|
cc9aa9eb3f
|
feat: add /models/apply endpoint to prepare models (#286)
|
2 years ago |
|
Ettore Di Giacinto
|
9d051c5d4f
|
feat: add image generation with ncnn-stablediffusion (#272)
|
2 years ago |
|
Ettore Di Giacinto
|
fd1df4e971
|
whisper: add tests and allow to set upload size (#237)
|
2 years ago |
|
Ettore Di Giacinto
|
9f426578cf
|
feat: add transcript endpoint (#211)
|
2 years ago |
mudler
|
e96eadab40
|
feat: support deprecated embeddings API
|
2 years ago |
|
mudler
|
857d13e8d6
|
debug: wire up go-fiber debugger
|
2 years ago |
|
Ettore Di Giacinto
|
c839b334eb
|
feat: add embeddings for go-llama.cpp backend (#190)
|
2 years ago |
|
Ettore Di Giacinto
|
52f4d993c1
|
feat: add /edit endpoint (#119)
|
2 years ago |
|
Ettore Di Giacinto
|
c806eae0de
|
feat: config files and SSE (#83)
Signed-off-by: mudler <mudler@mocaccino.org>
Signed-off-by: Tyler Gillson <tyler.gillson@gmail.com>
Co-authored-by: Tyler Gillson <tyler.gillson@gmail.com>
|
2 years ago |
|
Ettore Di Giacinto
|
12d83a4184
|
feat: Return OpenAI errors and update docs (#80)
Signed-off-by: mudler <mudler@mocaccino.org>
|
2 years ago |
|
Ettore Di Giacinto
|
1c872ec326
|
feat: add CI/tests (#58)
Signed-off-by: mudler <mudler@mocaccino.org>
|
2 years ago |
|
Ettore Di Giacinto
|
79791438fe
|
Use the first available model if not specified (#55)
Signed-off-by: mudler <mudler@mocaccino.org>
|
2 years ago |
|
Ettore Di Giacinto
|
5cba71de70
|
Add stopwords, debug mode, and other API enhancements (#54)
Signed-off-by: mudler <mudler@mocaccino.org>
|
2 years ago |
|
Ettore Di Giacinto
|
f816dfae65
|
Add support for stablelm (#48)
Signed-off-by: mudler <mudler@mocaccino.org>
|
2 years ago |
|
Ettore Di Giacinto
|
1c4fbaae20
|
Add support for cerebras (#45)
Signed-off-by: mudler <mudler@c3os.io>
|
2 years ago |
|
Ettore Di Giacinto
|
d517a54e28
|
Major API enhancements (#44)
|
2 years ago |
|
Ettore Di Giacinto
|
80f50e6ccd
|
Rename project to LocalAI (#35)
Signed-off-by: mudler <mudler@c3os.io>
|
2 years ago |
|
Ettore Di Giacinto
|
7fec26f5d3
|
Enhancements (#34)
Signed-off-by: mudler <mudler@c3os.io>
|
2 years ago |
|
Ettore Di Giacinto
|
0b330d90ad
|
feat: drop embedded webui (#27)
Signed-off-by: mudler <mudler@c3os.io>
|
2 years ago |
|
Ettore Di Giacinto
|
63601fabd1
|
feat: drop default model and llama-specific API (#26)
Signed-off-by: mudler <mudler@c3os.io>
|
2 years ago |
|
Ettore Di Giacinto
|
b062f3142b
|
feat: enhance API, expose more parameters (#24)
Signed-off-by: mudler <mudler@c3os.io>
|
2 years ago |
|
Ettore Di Giacinto
|
c4e94c88d7
|
Fix comment typo
Thanks to @deadprogram for noticing it!
|
2 years ago |
mudler
|
5556aa46dd
|
Small refinements and refactors
|
2 years ago |
|
mudler
|
ae30bd346d
|
Reorganize repository layout
|
2 years ago |
|
mudler
|
93d8977ba2
|
Return model list
|
2 years ago |
|
mudler
|
f43aeeb4a1
|
Add both API endpoints (completion, chat)
|
2 years ago |
|
mudler
|
c17dcc5e9d
|
Allow to inject prompt as part of the call
|
2 years ago |
|
mudler
|
b710147b95
|
Add mutex on same models (parallel isn't supported yet)
|
2 years ago |
|
mudler
|
ba70363330
|
Use template input
|
2 years ago |
|
mudler
|
9fb581739b
|
Allow to template model prompts inputs
|
2 years ago |
|
mudler
|
12eee097b7
|
Make it compatible with openAI api, support multiple models
Signed-off-by: mudler <mudler@c3os.io>
|
2 years ago |
|
mudler
|
b33d015b8c
|
Use go-llama.cpp
|
2 years ago |
|
mudler
|
e860e62036
|
Add mutex, build only lite images
|
2 years ago |
|
mudler
|
abee34f60a
|
Cleanup leftover
|
2 years ago |
|
mudler
|
dbc70dc13c
|
Add a simple web-page as index of the API for helping with inference testing
|
2 years ago |
|
mudler
|
9ba30c9c44
|
Update llama-go, allow to set context-size and enable alpaca model by default
|
2 years ago |
|
mudler
|
2ce1d51ad5
|
No need to set 0 for default context anymore
|
2 years ago |
|
mudler
|
d4720150b5
|
First import
|
2 years ago |
