Cover image

A Successful Run Is Not a Reproduced Result

TL;DR for operators An agent can finish a scientific simulation, generate plausible figures, and still leave the published claim unverified. PaperBenchX1 tests this distinction across 93 reproduction tasks. Its leading configuration earns 59.08% average rubric credit but fully reproduces only 13 tasks (13.98%) under the benchmark’s strict scoring rule. Validation is the weakest assessed stage. For R&D leaders, the decision is not simply which agent can operate scientific software; it is which agent can regenerate the specified evidence, demonstrate agreement with the scientific target, and report what remains unresolved. These results describe scoped computational tasks, not the probability of success in scientific research generally. ...

November 3, 2026 · 6 min · Zelina
Cover image

Better Predictions, Fewer Ideas: The Alpha Agent's Exploration Problem

TL;DR for operators An automated quantitative researcher can improve its predictions while becoming less effective at discovering different sources of predictive information. Better factor scores, more formulas, and broader productive research are not interchangeable measures of success. AlphaDiverse addresses this problem by training local agents to select complementary economic hypotheses and implement them as executable factors. Its reinforcement-learning objective rewards both predictive improvement and contributions that existing signals do not already provide. ...

October 23, 2026 · 10 min · Zelina
Cover image

Finding the Paper Is Not Enough: LKM Makes Scientific Reasoning Addressable

TL;DR for operators If two research systems start from the same candidate papers, use the same reranking process, have the same ten-paper writing budget, and use the same GPT-4o writer, should their final citations differ much? In Huang et al.’s study1, they do. When the writer also receives structured views that break papers into claims, premises, reasoning steps, conditions, and provenance, citation F1 rises by 5.3 points on ScholarQA-CS and 5.1 points on ScholarQA-Multi, with both precision and recall improving. ...

October 5, 2026 · 7 min · Zelina
Cover image

A Research Agent Should Leave a Paper Trail

TL;DR for operators A long-running research agent can produce an impressive manuscript while still leaving a manager unable to reconstruct what evidence was gathered, what failed, which claims were checked, or where a human should intervene. pAI/MSc1 is most useful as a response to that problem: although its fixed workflow uses 23 specialist agents across 30 graph nodes, its more consequential design choice is to preserve discovery, planning, theory, experimentation, synthesis, review, checkpoints, and budget accounting as named artifacts that can be inspected, resumed, audited, and structurally validated. ...

September 2, 2026 · 6 min · Zelina
Cover image

Laws and Order: Turning LLM Brainstorming into a Research Hypothesis Workflow

Brainstorming Is Cheap; Research Judgment Is Not Brainstorming with an LLM is easy. Ask for ten research ideas, wait a few seconds, and receive a confident menu of things that sound just plausible enough to be dangerous. Turn up the temperature and the machine becomes “creative.” Wonderful. We have successfully automated the whiteboard intern. ...

June 9, 2026 · 17 min · Zelina
Cover image

Clue by Clue: ProjectionBench and the Business of Testing AI Discovery

Clue by Clue: ProjectionBench and the Business of Testing AI Discovery Lab meeting. A scientist has a topic, a research question, and not much else. No dataset yet. No final chart. No results section quietly waiting in the appendix. Just a question and the uncomfortable business of guessing what nature might do. ...

June 3, 2026 · 16 min · Zelina
Cover image

Peer Pressure: AI Reviewers Pass the Item Test, Not the Replacement Test

Review is a strange business process. The visible output is a verdict: accept, reject, revise, approve, block, escalate. The useful output is usually smaller and more annoying: one specific criticism that is correct, important, and supported by evidence. That distinction is where the new paper On the limits and opportunities of AI reviewers: Reviewing the reviews of Nature-family papers with 45 expert scientists becomes more interesting than the usual “can AI replace reviewers?” theatre.1 The paper does not ask whether an AI reviewer can imitate a human reviewer’s overall score. It asks whether each individual criticism is any good. ...

June 3, 2026 · 17 min · Zelina
Cover image

Vibe Check: AutoResearch Is a Workflow, Not a Robot Scientist

Demo day is not discovery day Demo day has a familiar rhythm. An AI system reads papers, proposes an idea, edits code, runs an experiment, drafts a manuscript, and perhaps even produces something that looks suspiciously like a conference submission. The slide title then arrives with great ceremony: autonomous scientist. The paper AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery is useful because it interrupts that ceremony before everyone starts clapping at the PDF generator.1 Its central move is not to deny progress. Current systems really can automate meaningful pieces of research work. They can search, summarize, plan, code, run tools, assemble figures, and draft reports. That is already operationally important. ...

June 3, 2026 · 17 min · Zelina
Cover image

Silent Errors, Loud Consequences: ASMR-Bench and the Coming Era of AI Auditors

Code review is supposed to be the sober adult in the room. A researcher writes code. A reviewer checks the code. A suspicious bug gets caught before it becomes a chart, a memo, a product decision, or—if everyone is having a particularly expensive week—a board presentation. That model works reasonably well when the failure is accidental and the reviewer has more patience than the author. It becomes less reassuring when the author is an AI research agent, the codebase is messy, the experiment is expensive to rerun, and the suspicious line looks less like a bug than a perfectly normal design choice. ...

April 22, 2026 · 18 min · Zelina
Cover image

When AI Starts Writing Papers: The Rise of the Medical AI Scientist

Papers used to have a useful quality: they were difficult to produce. Not always good, unfortunately, but difficult. Someone had to identify a problem, read the literature, design the method, write the code, run the experiment, repair the code, compare the result, draw the figures, write the manuscript, and then survive peer review with only minor emotional damage. ...

March 31, 2026 · 16 min · Zelina