Tracing

Tracing in LLMOps captures the full execution path of a request through an LLM-powered system as a structured, hierarchical record of spans. A top-level span might represent a user query, with child spans for retrieval, each model call, and every tool invocation. Traces record inputs, outputs, latency, token counts, and metadata at every step. Tools such as LangSmith, Langfuse, and OpenTelemetry-compatible backends ingest these traces and enable operators to replay, debug, and benchmark system behavior.