Scientific-Agents

TL;DR for operators An analytical agent can select an appropriate tool, complete a computation, and return a plausible result while still being wrong at the point that matters operationally: deciding whether the result should be trusted, reported, stored, or used to launch further automated work. Brain Researcher addresses that later decision by making the research episode—not the model response—the governed unit of work. It constrains available resources, records provenance, tests alternative defensible specifications, assigns explicit states to scientific claims, and controls which results are eligible to enter memory. The paper reports a large improvement in first-action tool routing, from 23.3% without the system to 93.6% with it. Yet verified evidence grounding reaches only 22.0%, and an automated scientific-review layer still missed a scoring error that required human detection. ...

TL;DR for operators A scientific agent that generates 16 plausible hypotheses does not need every candidate to receive the same expensive treatment. The operational problem is deciding which hypotheses deserve simulation, experiment, or expert attention first. Rajwal, Das, and Ghosal show that, on a benchmark built from 1,323 published papers, simply measuring how strongly open-weight models internally support each candidate can rank the published hypothesis substantially better than asking GPT-5 to compare all candidates explicitly.1 Pooled first-place accuracy was 33.1% using normalized token likelihood and 32.8% using raw model logits, versus 16.6% for the tested zero-shot GPT-5 judge. ...