Cover image

When More Matches Stop Improving the Agent

TL;DR for operators Giving an AI coding agent more opportunities to test and rewrite its software does not guarantee that it will produce a stronger program. In a benchmark spanning 12 competitive games, the strongest evaluated model–harness configuration reached rank 1 against six historical human-program ladders. None of the tested configurations reached rank 1 in the remaining six games. Tripling the interaction budget in four difficult cases produced two improvements, two unchanged results, and no additional first-place finish. ...

November 18, 2026 · 10 min · Zelina