A Repair Log Is Not an Explanation
TL;DR for operators When a coding agent changes repository code, the resulting patch and test outcome reveal what was changed and whether the repair succeeded under the evaluation procedure. They do not necessarily explain why the agent selected that code or how its decision relates to the reported requirement. THEMIS attempts to preserve this missing information through stage-specific repair records. Yet its audit finds complete selected records in only 214 of 300 cases (71.3%), while many available diagnostic summaries have low confidence or limited specificity. A separate paired comparison reports 19 successful repairs versus 9 for a direct workflow, but cannot isolate the graph’s contribution. ...