Toxicity Evaluation

Toxicity evaluation detects harmful, offensive, or policy-violating content in model outputs across dimensions such as hate speech, explicit material, threats, and self-harm promotion. Evaluators combine classifier-based tools like Perspective API with human review and red-teaming. Continuous toxicity monitoring is essential in production because harmful outputs can emerge from novel input combinations that were not present during initial safety testing.