Parallel Tool Calls

Parallel tool calls allow a model to emit multiple tool invocation requests in a single generation step, which the runtime then executes concurrently before returning all results together. This dramatically reduces latency when subtasks are independent — for example, querying two databases simultaneously. The model must correctly identify which calls are independent; sequential dependencies cannot be parallelized and must remain ordered.