Commit Graph

41 Commits (bbc44689086191bbcaaef9d3205bf8996a7aa655)

Author SHA1 Message Date
mudler bbc4468908 Make functions more compatible with OpenAI specs 1 year ago
mudler 55befe396a Add grammar_json to the request parameters to facilitate JSON generation 1 year ago
mudler 483fddccf9 minor fixups 1 year ago
mudler 05aed255db Customize function call in templates 1 year ago
mudler 0f1326b2bd fixups 1 year ago
mudler b722e7eb7e feat: cleanups, small enhancements 1 year ago
mudler f09ddd2983 feat: add grammar and functions call support 1 year ago
Luis López a6839fd238
feat: [whisper] Partial support for verbose_json format in transcribe endpoint (#721) 1 year ago
Ettore Di Giacinto 02136531a3
fix: return index and delta in stream token (#680) 1 year ago
Ettore Di Giacinto 295f3030a9
feat: add typical_p to model parameters (#598) 1 year ago
Ettore Di Giacinto e37361985c
deps: update gpt4all bindings, fix search path on new versions (#592) 1 year ago
Ettore Di Giacinto 5abbb134d9
feat: extend model configuration for llama.cpp (#536) 1 year ago
Samuel Maynard 96794851b3
feat: add support for `Stream: true` to completionEndpoint (#465) 1 year ago
Robert Hambrock 4aa78843c0
fix: spec compliant instantiation and termination of streams (#341) 1 year ago
Ettore Di Giacinto 6f54cab3f0
feat: allow to set cors (#339) 1 year ago
Ettore Di Giacinto cc9aa9eb3f
feat: add /models/apply endpoint to prepare models (#286) 1 year ago
Ettore Di Giacinto 3f739575d8
Minor fixes (#285) 1 year ago
Ettore Di Giacinto 9d051c5d4f
feat: add image generation with ncnn-stablediffusion (#272) 1 year ago
Ettore Di Giacinto fd1df4e971
whisper: add tests and allow to set upload size (#237) 1 year ago
Ettore Di Giacinto 85f0f8227d
refactor: drop code dups (#234) 1 year ago
Matthew Campbell 032dee256f
Keep whisper models in memory (#233) 1 year ago
Matthew Campbell 6b5e2b2bf5
Upload transcription API wasn't reading the data from the post (#229) 1 year ago
Ettore Di Giacinto 9f426578cf
feat: add transcript endpoint (#211) 1 year ago
Ettore Di Giacinto 89dfa0f5fc
feat: add experimental support for embeddings as arrays (#207) 1 year ago
Dave 07ec2e441d
mini fix - OpenAI documentation url (#200) 1 year ago
mudler 009ee47fe2 Don't allow 0 as thread count 1 year ago
mudler b49721cdd1 fix: respect config from file for backends settings 1 year ago
mudler e96eadab40 feat: support deprecated embeddings API 1 year ago
mudler e73283121b feat: support arrays for prompt and input 1 year ago
Ettore Di Giacinto 961cf29217
feat: expose mirostat to config (#193) 1 year ago
Ettore Di Giacinto c839b334eb
feat: add embeddings for go-llama.cpp backend (#190) 1 year ago
Ettore Di Giacinto 714bfcd45b
fix: missing returning error and free callback stream (#187) 1 year ago
Ettore Di Giacinto fdf75c6d0e
rwkv fixes and examples (#185) 1 year ago
Ettore Di Giacinto c974dad799
Return usage in the API responses (#166) 1 year ago
Ettore Di Giacinto 67992a7d99
feat: support slices or strings in the prompt completion endpoint (#162) 1 year ago
Ettore Di Giacinto 1ae7150810
feat: allow to specify default backend for model (#156) 1 year ago
Ettore Di Giacinto 70caf9bf8c
feat: support stopwords both string and arrays (#154) 1 year ago
Dave 0b226ac027
Stop parameter of OpenAIRequest changed to String Array (#153) 1 year ago
Ettore Di Giacinto 220d6fd59b
feat: add stream events (#152) 1 year ago
Ettore Di Giacinto 52f4d993c1
feat: add /edit endpoint (#119) 1 year ago
Ettore Di Giacinto c806eae0de
feat: config files and SSE (#83) 1 year ago