Olivier Chafik
|
db288b60cb
|
tool-call: command r7b fix for normal responses (#11608)
* fix command r7b normal response regex + add to server test
* test multiline non-tool-call responses in test-chat
|
2025-02-04 15:48:53 +00:00 |
|
Olivier Chafik
|
cde3833239
|
tool-call: allow --chat-template chatml w/ --jinja, default to chatml upon parsing issue, avoid double bos (#11616)
* tool-call: allow `--jinja --chat-template chatml`
* fix double bos issue (drop bos/eos tokens from jinja template)
* add missing try catch around jinja parsing to default to chatml
* Simplify default chatml logic
|
2025-02-03 23:49:27 +00:00 |
|
Olivier Chafik
|
8b576b6c55
|
Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639)
---------
Co-authored-by: Xuan Son Nguyen <thichthat@gmail.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
|
2025-01-30 19:13:58 +00:00 |
|