Scientific AI

TL;DR for operators A technical assistant searching thousands of papers has two competing needs: preserve enough surrounding text to understand experimental context, and connect facts that are distributed across papers. A single retrieval score can make that choice look simpler than it is. In Gupta et al.’s Polymer Literature Scholar study,1 graph-based retrieval achieved full-corpus recall of 0.903–0.938, versus 0.717 for dense text retrieval. Yet answer accuracy remained close: 0.964–0.973 for GraphRAG and 0.960 for VectorRAG. The retriever that was substantially better at recovering designated evidence was only modestly better at producing correct answers. ...

TL;DR for operators SciPredict finds that frontier LLMs predict outcomes of recent natural-science experiments with roughly 14-26% accuracy, compared with about 20% for domain experts. That headline can make model performance look surprisingly competitive. It should not be read as evidence that these systems are ready to decide which experiments can safely be skipped. ...

TL;DR for operators A simulator can generate effectively unlimited trajectories. That does not automatically make those trajectories useful training data for a reasoning model. Sim2Reason turns simulated mechanics into questions with answers that can be checked automatically, then uses those questions for reinforcement-learning post-training. The reported transfer is substantial enough to matter operationally: on Qwen2.5-32B, International Physics Olympiad mechanics accuracy rose from 19.8% to 25.2%. By contrast, supervised fine-tuning on 200,000 teacher-generated trajectories lowered the same score to 15.9%. ...

TL;DR for operators The paper addresses a problem that appears after literature retrieval succeeds. A research organization may already have the relevant papers and may even have extracted the reported measurements, yet those observations can still be unsafe to combine because material names, property definitions, units, temperatures, methods, and other conditions do not align. ...

TL;DR for operators A useful scaling law does not merely say “bigger is better.” That is not a law; that is a purchasing department with a GPU account. The paper behind this article studies whether the composition of pretraining data can change the compute-optimal balance between model size and downstream data in jet classification.1 The answer, in this setting, is yes. Training from scratch on JetClass produces a nearly balanced scaling rule: as compute grows, the optimal model size and dataset size grow at roughly similar rates. But after pretraining on a JetClass-II corpus augmented with Beyond Standard Model resonance decays, the compute-optimal rule shifts sharply toward downstream data. More of the next compute budget should be spent processing more examples, not inflating the model. ...

TL;DR for operators LabVLA is best read as an operating system for laboratory robot supervision, not as another paper claiming the robot scientist has arrived. The authors argue that laboratory automation is constrained by data and embodiment: most vision-language-action models have learned household and tabletop manipulation, but not pipettes, beakers, heaters, transparent liquids, instrument buttons, protocol steps, or the awkward fact that different robots have different bodies.1 ...

Drug discovery is a wonderful place for AI demos. The model proposes a molecule, the molecule looks plausible, a docking score improves, and the slide deck starts to glow with that familiar color: almost-commercial blue. Then the evaluation protocol arrives and ruins the party. The problem is simple, and therefore easy to underestimate. A drug discovery agent is rarely asked to return one impressive molecule. It is asked to return a set of molecules that jointly satisfies several requirements: enough candidates, enough diversity, acceptable binding proxies, drug-likeness, synthetic accessibility, novelty, and other threshold-style constraints. One molecule can look good. A few molecules can look good. The final returned pool can still fail. ...

Confidence is cheap. Calibration is expensive. That is the uncomfortable lesson behind a new arXiv paper on earthquake source inversion, a domain that sounds safely remote until one notices the pattern: a complex physical simulator, uncertain model inputs, high-dimensional observations, and a decision-maker who wants a probability distribution rather than a shrug.1 Replace “earthquake waveform” with “financial stress scenario,” “robot sensor stream,” “industrial digital twin,” or “clinical simulator,” and the problem becomes less geological and more familiar. ...

A materials lab does not need an AI system that can politely imitate the periodic table. It needs one that can search. That difference sounds small until money enters the room. In materials discovery, every serious candidate eventually asks for simulation time, specialist review, density functional theory validation, and—if it survives long enough—lab synthesis. A model that produces many plausible crystals is useful. A model that pushes candidates toward a target property before the expensive validation begins is more useful. Less glamorous, perhaps. But so is a good spreadsheet, and civilization somehow survives. ...

Beams are honest objects. Push them, load them, move their supports, and they obey equilibrium equations without theatrical ambiguity. Language models, unfortunately, are less well-behaved. That is what makes BeamPERL a useful paper. It does not test LLM reasoning on a vague benchmark where “correctness” means pleasing a judge, matching a rubric, or sounding sufficiently graduate-school. It asks a compact reasoning model to solve a classical beam statics task: calculate support reactions for a loaded beam. The answers can be checked by a symbolic solver. The reward can be exact. No vibes, no partial credit, no “the answer feels plausible.”1 ...