When Saying Less Scores More: The Win-by-Silence Failure in AI Plan Evaluation
TL;DR for operators If an AI-generated plan is scored before its real-world outcome is known, a higher score need not mean a stronger or more complete plan. In the benchmark studied here, every one of 26 routes had at least one intermediate transition whose deletion increased the fixed-parameter score. Across all 57 admissible deletions, 27 raised the score. ...