AutoResearch

Demo day is not discovery day Demo day has a familiar rhythm. An AI system reads papers, proposes an idea, edits code, runs an experiment, drafts a manuscript, and perhaps even produces something that looks suspiciously like a conference submission. The slide title then arrives with great ceremony: autonomous scientist. The paper AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery is useful because it interrupts that ceremony before everyone starts clapping at the PDF generator.1 Its central move is not to deny progress. Current systems really can automate meaningful pieces of research work. They can search, summarize, plan, code, run tools, assemble figures, and draft reports. That is already operationally important. ...

Search is where many AI systems become embarrassingly human. They try one move. It fails. They try a nearby move. It fails. Then, with the serene confidence of a spreadsheet macro wearing a lab coat, they try the first move again. That is the real problem behind many “autonomous research” demonstrations. The issue is not always that the model cannot propose useful ideas. It is that the loop around the model is fixed: propose a change, run an experiment, evaluate the result, keep or discard. Once this loop gets stuck, the system often has no way to ask the more important question: is my search process itself badly designed? ...