Skip to content
ML Academy

Introduced on day 45

Regression suite

The set of fixed test cases run automatically on every prompt, model or data change to block releases that break behaviour that used to work, including safety and refusal behaviour.

In detail

It combines the golden set, cases derived from past incidents and dedicated safety slices, with explicit thresholds per slice. Because fine-tuning and prompt changes can degrade unrelated behaviour, the suite runs on every candidate, not only when the intended capability changes.