Cover image

When AI Can Solve But Can't Search: The MathNet Equation

Search. That is the unglamorous part of AI work. The demo asks a model to solve a clean problem. The enterprise system asks a model to find the right prior case, retrieve the relevant precedent, avoid the misleading near-match, and then adapt the answer without making a confident mess of it. MathNet is interesting because it puts that distinction under pressure. The paper introduces a large multilingual, multimodal Olympiad mathematics benchmark, but the more useful business lesson is not merely that frontier models can solve hard math. We already have enough leaderboards wearing medals. The sharper finding is that models and embedding systems can still fail at recognizing when two problems are mathematically the same, or when one problem is structurally useful for another.1 ...

April 23, 2026 · 13 min · Zelina
Cover image

House of Cards, House of Algorithms: Why Game AI Needs Better Testbeds

Benchmarks are the places where AI systems go to look impressive. That is not automatically a problem. A good benchmark clarifies what a system can do, what it cannot do, and where progress is real. A bad benchmark performs a more theatrical function: it lets researchers win a carefully chosen game, write a confident conclusion, and quietly hope nobody asks whether the result survives contact with another task. ...

March 4, 2026 · 16 min · Zelina
Cover image

When Models Get Lost in Space: Why MLLMs Still Fail Geometry

Geometry looks clean. A cube has edges. A projection has rules. A missing view should follow from the views already shown. This is not the messy world of occluded street scenes, motion blur, shadows, or a warehouse camera pointed at the wrong shelf. It is the kind of visual reasoning many students learn before they are trusted with anything more dangerous than a compass, a ruler, and mild boredom. ...

February 14, 2026 · 15 min · Zelina
Cover image

FIRE-BENCH: Playing Back the Tape of Scientific Discovery

A demo can make an AI research agent look impressive in ten minutes. Give it a task, watch it create files, install packages, run experiments, generate tables, and write something that sounds like a conclusion. Productivity theater, now with terminal logs. The harder question is less cinematic: did it actually discover the right thing? ...

February 5, 2026 · 14 min · Zelina
Cover image

When LLMs Meet Time: Why Time-Series Reasoning Is Still Hard

Dashboard numbers are seductive because they look obedient. Revenue goes up, traffic dips, latency spikes, inventory turns over, temperature drifts, volatility clusters. Put the sequence into a chart and the pattern seems almost polite. Then someone asks an LLM what happened. The model answers fluently. It may even sound like an analyst who has seen too many quarterly review decks and has developed a protective layer of confidence. But fluency is not temporal understanding. A model can describe a curve, name a trend, and still fail to understand which segment comes next, whether a transformation is correct, or whether a discontinuity is an error or a legitimate feature of the process. ...

February 3, 2026 · 16 min · Zelina
Cover image

RxnBench: Reading Chemistry Like a Human (Turns Out That’s Hard)

A reaction scheme looks like a picture. To a chemist, it is closer to a compressed process model. A few arrows may encode the starting materials, catalysts, solvents, temperatures, intermediate states, selectivity, yield, and the structural change that makes the entire experiment worth publishing. Reading that scheme correctly is already difficult. Reading the paper around it is worse. ...

December 31, 2025 · 15 min · Zelina
Cover image

Benchmarks on Quicksand: Why Static Scores Fail Living Models

A benchmark score looks wonderfully solid until the model changes, the dataset changes, the deployment stack changes, the GPU behaves differently, the logging pipeline drops half the useful metadata, and someone asks whether the result still means anything for their actual application. At that point, the leaderboard number is not wrong. It is worse: it is under-described. ...

December 15, 2025 · 19 min · Zelina
Cover image

Scientific Reasoning Under the Microscope: How PRiSM Stress-Tests the New Generation of Multimodal Models

Scientific Reasoning Under the Microscope: How PRiSM Stress-Tests the New Generation of Multimodal Models Grades are comforting. A model solves 80% of the benchmark, the leaderboard smiles, the demo team relaxes, and someone in procurement quietly starts asking whether the engineering team still needs that many humans. This is usually the part where reality coughs politely. ...

December 8, 2025 · 18 min · Zelina
Cover image

When Motion Lies: Why Video LLMs Keep Misreading Physics

A car approaches a crosswalk. The frames look simple: car, road, direction, movement. A human can still ask the useful question: is the car speeding up, slowing down, or merely moving at a steady pace? A video language model may answer with the confidence of a dashboard camera that has read too many captions and learned too little physics. It sees a car getting closer. It infers “accelerating.” The problem is not that the model missed the car. The problem is that it saw the same visual pattern and failed to model the hidden change in motion. ...

December 7, 2025 · 16 min · Zelina
Cover image

Benchmarks Are From Mars, Workflows Are From Venus: Why AI Research Co‑Pilots Keep Failing in the Wild

Lab meeting. The principal investigator cuts the validation budget from $15,000 to $5,000. The postdoc has already discussed the original plan with an AI research co-pilot. The agent previously suggested a 10-marker flow cytometry panel, bulk RNA-seq validation, and immunofluorescence. Now the researcher returns and says: we need to prioritize. A useful co-pilot should not simply repeat the original protocol with a smaller price tag. It should remember the hypothesis, preserve the scientific goal, understand the new constraint, propose a cheaper validation path, and know which evidence can be deferred without making the proposal look scientifically flimsy. In other words, it must behave less like a brilliant autocomplete box and more like a collaborator with a working memory, a sense of context, and a modest respect for reality. A rare feature, apparently. ...

December 6, 2025 · 16 min · Zelina