Different Rubrics, Nearly the Same Scoring Lever
TL;DR for operators An AI evaluator may report separate judgments about grammar, vocabulary, and coherence without applying those criteria independently. In a study of 25 base language models, interventions targeting the rubric that had been degraded produced only 0.0074 more expected score points than interventions targeting other rubrics—just 1.74% of the absolute matching effect. The difference was statistically detectable but far below the researchers’ practical significance threshold. ...