Guardrail Service

A guardrail service is a layer deployed around a language model that intercepts inputs and outputs to enforce safety, compliance, and policy constraints. Input guardrails filter harmful, off-topic, or sensitive queries before they reach the model; output guardrails scan generated responses for policy violations, personally identifiable information, or factual claims that require human review. Guardrails may be rule-based classifiers, fine-tuned models, or LLM judges, and their latency contribution must be accounted for in the overall latency budget.