Cover image

Measure Twice, Deploy Once: The Hidden Geometry of Reliable AI

TL;DR for operators The practical problem is not that AI systems lack benchmarks. We are drowning in benchmarks. The problem is that many benchmarks, design scores, and demo metrics politely avoid the failure modes that will later become incident reports, refund requests, clinical risk reviews, or broken robots wedged under furniture. Two recent papers make the same point from very different directions. One studies Argus, a spherical, many-legged robot designed around dynamic isotropy: the uniformity of attainable center-of-mass acceleration across directions.1 The other reworks panoptic segmentation evaluation by replacing a fixed one-to-one segment matching rule with a configurable assignment framework that can handle fragmentation, merging, thresholds, Voronoi regions, and part-aware targets.2 ...

June 20, 2026 · 14 min · Zelina
Cover image

Context Collapse: Why AI’s Next Bottleneck Is Knowing What Matters

TL;DR for operators AI is getting fluent enough to be dangerous in boring ways. It can describe a scene, generate a video, and write a policy memo with impressive confidence. The problem is that real operations rarely fail at the level of generic fluency. They fail when the system confuses which person did what, blends event one into event two, or treats a documented atrocity as a debate club prompt because a user asked for “balance”. ...

June 17, 2026 · 17 min · Zelina
Cover image

The Path of Least Assurance: Why AI Reliability Lives Between the Steps

TL;DR for operators AI reliability is increasingly a process problem, not an answer-checking problem. Three recent arXiv papers make that point from very different angles. MoCo-EA shows that adversarial examples are not merely isolated malicious pixels lurking in the shrubbery; they can lie along continuous, optimisable paths.1 ConceptAgent shows that erasing a concept from a diffusion model may disrupt the early text-to-image link while leaving later trajectory dynamics available for concept re-entry.2 BlueFin shows that LLM agents doing finance spreadsheet work fail in ways that only appear when you inspect formulas, recalculation behaviour, workbook mutations, tool choices, and whether the output helps a human analyst do useful work.3 ...

June 17, 2026 · 18 min · Zelina
Cover image

Judge, Jury, and Calibration: Why AI Evaluation Needs Anchors

TL;DR for operators AI is becoming very good at producing judgement-shaped output. That is not the same thing as judgement. Two recent papers make the same operational point from different sides: one shows how AI can estimate educational item difficulty before response data are available; the other shows how LLM-generated peer reviews can look serious while diverging from human reviewing behaviour.12 ...

June 15, 2026 · 14 min · Zelina
Cover image

Pre-Review, Not Peer Review: The Drafting Gate AI Actually Earns

TL;DR for operators AI-Paper-Review is useful because it behaves like a disciplined pre-submission review room, not because it makes peer reviewers obsolete. The system selects a panel of AI reviewer personas, makes them review independently, clusters duplicated concerns, ranks the resulting issues by consensus and severity, then compares them with human reviews. That mechanism matters more than the slogan, because raw AI critique is cheap, noisy, and very good at sounding busy. ...

June 15, 2026 · 18 min · Zelina
Cover image

Wait, Let Me Check: Why Long-CoT AI Can Still Verify the Wrong Thing

Checking is supposed to calm people down. In business, a second review makes a financial model feel safer. A compliance checklist makes a release feel governed. A senior analyst saying “let me double-check that” gives the room a small dopamine hit of procedural seriousness. Long Chain-of-Thought models have learned the same theatre. They pause. They reconsider. They say “wait.” They verify arithmetic. They sometimes generate reasoning traces so long that one begins to feel the model must be thinking deeply, if only because wasting that many tokens while being shallow seems rude. ...

June 9, 2026 · 19 min · Zelina
Cover image

Blink and You Miss It: The Two-Stage Reality Check for Multimodal AI

Multimodal AI has reached the point where it can describe videos, summarize documents with images, answer visual questions, and generate outputs that look satisfyingly complete. This is exactly why evaluation is becoming more dangerous. A system that looks competent is not necessarily reliable. It may miss the one-second event that determines the answer. Or it may notice enough evidence but then produce a fluent, attractive, visually decorated summary that quietly distorts the facts. The first failure is upstream: the model did not capture the decisive evidence. The second is downstream: the output did not preserve and present the evidence in a human-useful way. ...

June 8, 2026 · 17 min · Zelina
Cover image

Pixels to Purchase Orders: A Business Map for Choosing Vision-Language Models

Pixels to Purchase Orders: A Business Map for Choosing Vision-Language Models Receipts are a good way to ruin an AI demo. A clean product photo is polite. A scanned receipt is not. It has shadows, folds, strange fonts, tiny numbers, merchant abbreviations, table-like structure, and one suspiciously important total amount hiding near the bottom. Ask a generic multimodal assistant what it sees, and it may produce an answer that sounds fluent enough to make everyone in the meeting relax. That is usually the dangerous part. ...

June 8, 2026 · 19 min · Zelina
Cover image

Search, Critique, Repeat: Critic-R Turns RAG Complaints into Retriever Training

Search failure is boring until it becomes expensive. A research agent asks for evidence. The retriever returns documents. The reasoning model reads them, continues writing, and eventually produces a confident answer. Somewhere in the middle, the evidence was slightly wrong: not irrelevant enough to trigger an obvious failure, not useful enough to support the next reasoning step. The agent proceeds anyway, because that is what agents do when we dress up uncertainty as workflow automation. ...

June 8, 2026 · 17 min · Zelina
Cover image

Pretty Text, Ugly Logic: When Image Models Learn to Write but Not to Reason

A slide looks finished. The headline is sharp, the equations are aligned, the answer box is confident, and the design has the mild corporate glow of something that has already been approved by three people who did not read it. That is exactly the problem. For years, text-to-image models failed in a wonderfully obvious way: they could not spell. A poster would say “Qaurterly Reveneu,” the mockup button would contain mystical glyphs, and everyone understood the output was decorative, not operational. Recent models have changed that. They can now place readable text inside images, produce document-like pages, and generate slide-like visual artifacts. The failure mode has become less funny and more expensive: the text may be readable, but the reasoning may be wrong. ...

June 7, 2026 · 15 min · Zelina