Cover image

The Leaderboard Can Pick the Wrong Model

TL;DR for operators A visible development metric can be a poor basis for choosing an AI system when it measures only part of the outcome that ultimately matters. In this CBCT report-generation study, the variant tuned for lexical overlap produced the highest BLEU-4 among the deployable systems but scored only 0.2909 on the reconstructed composite objective. An objective-aware decoder with geometry gating reached 0.4122 despite lower BLEU-4. ...

October 15, 2026 · 7 min · Zelina
Cover image

Beyond Answers: Measuring How Deep Research Agents Really Think

A research report is not an answer with extra paragraphs. That sounds obvious until an enterprise team tries to evaluate a deep research agent by asking whether its final conclusion looks plausible, whether it included citations, and whether the prose sounded confident enough to survive a board deck. Congratulations: the machine has produced something that resembles diligence. Whether it actually performed diligence is the inconvenient question. ...

October 9, 2025 · 15 min · Zelina