When the Rule Changes but the Verdict Doesn't
TL;DR for operators An AI compliance checker can classify more than 90% of cases correctly while leaving most verdicts unchanged when the supplied regulation is removed or modified. In a five-model audit spanning 20 regulatory domains, the four general-purpose models achieved 90.3–91.9% accuracy but only 7.0–9.4% aggregate sensitivity to rule changes. For teams procuring or deploying compliance automation, benchmark accuracy does not establish that the system’s decisions depend on the customer’s governing rules. Counterfactual tests that delete, substitute, or negate rules provide an additional diagnostic. But low sensitivity is not proof that a model ignored the regulation: some scenarios independently reveal the likely verdict, and sensitivity changes substantially across datasets. ...