c71c729bc2
debug
1 year ago
94916749c5
feat: add external grpc and model autoloading
1 year ago
47cc95fc9f
feat: add all backends to autoload
...
Now since gRPCs are not crashing the main thread we can just greedly
attempt all the backends we have available.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 year ago
3feb632eb4
refactor: rename "llama-master" and "llama" ( #776 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 year ago
236497e331
feat: resolve JSONSchema refs (planners) ( #774 )
1 year ago
6352448b72
feat: add llama-master backend ( #752 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 year ago
1d0ed95a54
feat: move other backends to grpc
...
This finally makes everything more consistent
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 year ago
5dcfdbe51d
feat: various refactorings
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 year ago
f2f1d7fe72
feat: use gRPC for transformers
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 year ago
ae533cadef
feat: move gpt4all to a grpc service
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 year ago
58f6aab637
feat: move llama to a grpc
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 year ago
b816009db0
feat: add falcon ggllm via grpc client
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 year ago
55befe396a
Add grammar_json to the request parameters to facilitate JSON generation
1 year ago
c0578031b5
Add tests
...
Signed-off-by: mudler <mudler@localai.io>
1 year ago
b722e7eb7e
feat: cleanups, small enhancements
...
Signed-off-by: mudler <mudler@localai.io>
1 year ago
f09ddd2983
feat: add grammar and functions call support
1 year ago
a6839fd238
feat: [whisper] Partial support for verbose_json format in transcribe endpoint ( #721 )
1 year ago
bf5acf646e
fix: adapt whisper to bindings updates ( #702 )
...
Signed-off-by: mudler <mudler@localai.io>
1 year ago
78f3c3da48
refactor: consolidate usage of GetURI ( #674 )
...
Signed-off-by: mudler <mudler@localai.io>
1 year ago
d18f85df46
fix: add tags
...
Signed-off-by: mudler <mudler@localai.io>
1 year ago
6213da330a
fix: add omitempty where needed ( #671 )
1 year ago
60db5957d3
Gallery repository ( #663 )
...
Signed-off-by: mudler <mudler@localai.io>
1 year ago
a7bb029d23
feat: add tts with go-piper ( #649 )
...
Signed-off-by: mudler <mudler@localai.io>
1 year ago
e37361985c
deps: update gpt4all bindings, fix search path on new versions ( #592 )
1 year ago
84946e9275
feat: display download progress when installing models ( #543 )
1 year ago
d62aef2016
feat: add experimental support for falcon-7b ( #516 )
...
Signed-off-by: mudler <mudler@mocaccino.org>
1 year ago
b447a2a719
feat: support upscaled image generation with esrgan ( #509 )
1 year ago
78ad4813df
feat: Update gpt4all, support multiple implementations in runtime ( #472 )
...
Signed-off-by: mudler <mudler@mocaccino.org>
1 year ago
3ba07a5928
feat: add LangChainGo Huggingface backend ( #446 )
...
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
1 year ago
9decd0813c
feat: update go-gpt2 ( #359 )
...
Signed-off-by: mudler <mudler@mocaccino.org>
2 years ago
05a3d569b0
feat: allow to override model config ( #323 )
2 years ago
1fade53a61
feat: minor enhancements to /models/apply ( #297 )
2 years ago
cc9aa9eb3f
feat: add /models/apply endpoint to prepare models ( #286 )
2 years ago
9d051c5d4f
feat: add image generation with ncnn-stablediffusion ( #272 )
2 years ago
2a9d7474ce
fix(rwkv): load tokenizer file from model path ( #255 )
2 years ago
8250391e49
Add support for gptneox/replit ( #238 )
2 years ago
fd1df4e971
whisper: add tests and allow to set upload size ( #237 )
2 years ago
4413defca5
feat: add starcoder ( #236 )
2 years ago
85f0f8227d
refactor: drop code dups ( #234 )
2 years ago
59e3c02002
make use of new bindings for gpt4all ( #232 )
2 years ago
032dee256f
Keep whisper models in memory ( #233 )
2 years ago
11675932ac
feat: add dolly/redpajama/bloomz models support ( #214 )
2 years ago
f8ee20991c
feat: add bert.cpp embeddings ( #222 )
2 years ago
9f426578cf
feat: add transcript endpoint ( #211 )
2 years ago
c839b334eb
feat: add embeddings for go-llama.cpp backend ( #190 )
2 years ago
714bfcd45b
fix: missing returning error and free callback stream ( #187 )
2 years ago
751b7eca62
feat: add rwkv support ( #158 )
...
Signed-off-by: mudler <mudler@mocaccino.org>
2 years ago
1ae7150810
feat: allow to specify default backend for model ( #156 )
...
Signed-off-by: mudler <mudler@c3os.io>
2 years ago
156e15a4fa
Bump llama.cpp, downgrade gpt4all-j ( #149 )
2 years ago
92452d46da
feat: add new gpt4all-j binding ( #142 )
2 years ago
Ettore Di Giacinto
Ettore Di Giacinto
Luis López
Pavel Zloi
Matthew Campbell