The Leaderboard Can Pick the Wrong Model
TL;DR for operators A visible development metric can be a poor basis for choosing an AI system when it measures only part of the outcome that ultimately matters. In this CBCT report-generation study, the variant tuned for lexical overlap produced the highest BLEU-4 among the deployable systems but scored only 0.2909 on the reconstructed composite objective. An objective-aware decoder with geometry gating reached 0.4122 despite lower BLEU-4. ...