Piotr 3cb203c89f llama-chat : Do not throw when tool parsing fails (#14012) ...

Currently when a model generates output which looks like a tool call,
but is invalid an exception is thrown and not handled, causing the cli
or llama-server to bail. Instead, handle the chat parser exception and
simply return the generated text in such cases.

Signed-off-by: Piotr Stankiewicz <piotr.stankiewicz@docker.com>

2025-06-14 17:25:15 +01:00

4.1 KiB

Raw Blame History

View Raw