Safety Filter

A safety filter is an automated component that classifies model inputs or outputs against one or more harm categories and blocks, rewrites, or flags content that exceeds a risk threshold. Filters are typically fine-tuned classifiers or moderation models trained on labeled examples of safe and unsafe content. They are a practical first line of defense in production deployments, though they are imperfect: they can be bypassed by clever adversarial inputs and may produce false positives that block legitimate requests.