Regression Suite

A regression suite is a curated, stable set of test cases that is run against every candidate model or prompt version to verify that previously passing behaviors have not degraded. Unlike an exploratory evaluation dataset that grows continuously, the regression suite is deliberately kept frozen between deliberate expansion events so that scores are comparable across runs. Regression suites typically cover golden examples, known failure modes, safety-critical scenarios, and representative samples from each major query category.