Asking Better Does Not Mean Specifying Better
TL;DR for operators When a stakeholder gives a coding agent a vague software request, asking clarification questions can improve the resulting specification. But asking effective questions and accurately documenting the answers are different capabilities. A benchmark covering 341 development tasks finds that the model with the highest proportion of effective clarification questions achieves substantially lower requirement alignment than the model with the lowest proportion. Coding-agent harnesses also improve question-level metrics while generally weakening specification quality. ...
