CS348Project/llama.cpp
5
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2025-10-27 08:21:30 +00:00
Code Issues Packages Projects Releases Wiki Activity

server : add documentation for parallel_tool_calls param (#15647)

Browse Source 
Co-authored-by: Pierre F <no@p.e>
This commit is contained in:
ExtReMLapin
2025-08-29 19:25:40 +02:00
committed by GitHub
parent 81017865ee
commit 792b44f2ed
2 changed files with 4 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
tools/server/README.md
View File

@@ -1143,6 +1143,8 @@ The `response_format` parameter supports both plain JSON output (e.g. `{"type":
`parse_tool_calls`: Whether to parse the generated tool call.
`parallel_tool_calls` : Whether to enable parallel/multiple tool calls (only supported on some models, verification is based on jinja template).
*Examples:*
You can use either Python `openai` library with appropriate checkpoints: