Commit Graph

32 Commits (46b9445fa6daa89c96cc50d78d94e99a9bc963fa)

Author SHA1 Message Date
Ettore Di Giacinto 295f3030a9
feat: add typical_p to model parameters (#598) 1 year ago
Ettore Di Giacinto e37361985c
deps: update gpt4all bindings, fix search path on new versions (#592) 1 year ago
Ettore Di Giacinto 5abbb134d9
feat: extend model configuration for llama.cpp (#536) 1 year ago
Samuel Maynard 96794851b3
feat: add support for `Stream: true` to completionEndpoint (#465) 1 year ago
Robert Hambrock 4aa78843c0
fix: spec compliant instantiation and termination of streams (#341) 2 years ago
Ettore Di Giacinto 6f54cab3f0
feat: allow to set cors (#339) 2 years ago
Ettore Di Giacinto cc9aa9eb3f
feat: add /models/apply endpoint to prepare models (#286) 2 years ago
Ettore Di Giacinto 3f739575d8
Minor fixes (#285) 2 years ago
Ettore Di Giacinto 9d051c5d4f
feat: add image generation with ncnn-stablediffusion (#272) 2 years ago
Ettore Di Giacinto fd1df4e971
whisper: add tests and allow to set upload size (#237) 2 years ago
Ettore Di Giacinto 85f0f8227d
refactor: drop code dups (#234) 2 years ago
Matthew Campbell 032dee256f
Keep whisper models in memory (#233) 2 years ago
Matthew Campbell 6b5e2b2bf5
Upload transcription API wasn't reading the data from the post (#229) 2 years ago
Ettore Di Giacinto 9f426578cf
feat: add transcript endpoint (#211) 2 years ago
Ettore Di Giacinto 89dfa0f5fc
feat: add experimental support for embeddings as arrays (#207) 2 years ago
Dave 07ec2e441d
mini fix - OpenAI documentation url (#200) 2 years ago
mudler 009ee47fe2 Don't allow 0 as thread count 2 years ago
mudler b49721cdd1 fix: respect config from file for backends settings 2 years ago
mudler e96eadab40 feat: support deprecated embeddings API 2 years ago
mudler e73283121b feat: support arrays for prompt and input 2 years ago
Ettore Di Giacinto 961cf29217
feat: expose mirostat to config (#193) 2 years ago
Ettore Di Giacinto c839b334eb
feat: add embeddings for go-llama.cpp backend (#190) 2 years ago
Ettore Di Giacinto 714bfcd45b
fix: missing returning error and free callback stream (#187) 2 years ago
Ettore Di Giacinto fdf75c6d0e
rwkv fixes and examples (#185) 2 years ago
Ettore Di Giacinto c974dad799
Return usage in the API responses (#166) 2 years ago
Ettore Di Giacinto 67992a7d99
feat: support slices or strings in the prompt completion endpoint (#162) 2 years ago
Ettore Di Giacinto 1ae7150810
feat: allow to specify default backend for model (#156) 2 years ago
Ettore Di Giacinto 70caf9bf8c
feat: support stopwords both string and arrays (#154) 2 years ago
Dave 0b226ac027
Stop parameter of OpenAIRequest changed to String Array (#153) 2 years ago
Ettore Di Giacinto 220d6fd59b
feat: add stream events (#152) 2 years ago
Ettore Di Giacinto 52f4d993c1
feat: add /edit endpoint (#119) 2 years ago
Ettore Di Giacinto c806eae0de
feat: config files and SSE (#83) 2 years ago