Cover image

200 Robot Environments, Zero Test Completions

TL;DR for operators Coding agents can now construct robotics simulations that would traditionally require substantial specialist engineering. Whether the resulting environments are physically reliable, and whether autonomous controllers can perform the simulated work, are separate questions. In Gym-Anything for Robotics, researchers build 25 simulations containing 200 reinforcement-learning environments. Three frontier coding agents achieve zero success on all 25 official test tasks, although they complete some easier tasks. Independent auditing exposes physical defects in approximately three quarters of the generated simulations before repair. ...

November 15, 2026 · 9 min · Zelina
Cover image

Remembering Why Is Not Proving Why

TL;DR for operators A research agent can preserve an experiment without preserving why its result might hold. CauProphet1 addresses this by storing reusable causal hypotheses with supporting evidence, contradictions, and applicability conditions, then adapting them to new tasks. Across two chronological financial factor studies, the system improves mean next-period RankIC by 25.4% relative to ReAct with text memory, although it performs worse in the volume-only study. It also improves pre-resolution forecasting accuracy and intervention-effect estimation in selected benchmarks. These are task-performance results, not proof that its stored causal relationships are correct. ...

November 11, 2026 · 9 min · Zelina
Cover image

The Verdict Is Not the Evidence

TL;DR for operators In Beyond QASecClaw: Agent Scaling, Verifier Feedback, and Evidence Reliability in Software Assurance1, additional LLM assessment contexts did not consistently make defect-clearance decisions safer. Scaling from one to 50 contexts increased token consumption approximately 49-fold on eight authored Java warning controls without meaningfully reducing unsafe clearance. Raw formal-verifier feedback improved correct assertion verdicts but also increased incorrect ones. More surprisingly, models frequently rejected valid counterexamples that correctly demonstrated program defects. ...

November 11, 2026 · 10 min · Zelina
Cover image

The Incident That Never Reached the Ledger

TL;DR for operators An AI agent can assess an incident without reliably passing the information to the next agent. When its reporting decision depends on retrieved relationship histories, accurate upstream evaluation does not guarantee that a required event enters organizational memory. RelLedger1 investigates this failure at the actual record-write boundary. Its clearest executable result comes from 24 simulated company workflows: changing Claude’s retrieved relationship history from warm to strained reduced ledger writes by 37.50 percentage points and downstream reviews by 45.83 points. Both differences had familywise confidence intervals excluding zero. ...

November 8, 2026 · 9 min · Zelina
Cover image

When AI Reviewers Are Talked Into Approval

TL;DR for operators An AI reviewer can have explicit instructions, access to supporting documents, and responsibility for approving a proposal, yet still change its decision after interacting with another agent instructed to influence it. Across three simulated oversight environments, assigning deception objectives increased reviewer approval probability by 31.20 percentage points, compared with 18.94 points for persuasion and 5.72 points for coercion. These are full-sample experimental effects of assigning an influence objective, not measurements of spontaneous malicious behaviour. ...

November 8, 2026 · 9 min · Zelina
Cover image

The Facts Didn't Make It to the Decision

TL;DR for operators An AI team can possess every fact needed for a decision and still reach the wrong conclusion. TeamGym, a benchmark for distributed-information decision-making, reports an average 22.9-percentage-point loss in decision success when necessary facts are distributed among agents instead of given to one agent. Requiring those agents to retrieve the facts from source documents introduces a further 19.9-point loss.1 ...

November 7, 2026 · 10 min · Zelina
Cover image

Train the Advice, Not Just the Agent

TL;DR for operators A multi-step AI agent may retrieve useful information, lose track of a task constraint, or continue searching after it already has enough evidence. A separate advisor can recommend the next action, but asking a larger model for feedback does not guarantee that the advice will improve task completion. Caddie1 trains an advisor using what happens after the acting agent follows its suggestions. On MuSiQue with supplied passages, a Qwen3-4B agent improves from 21.56% success without assistance to 46.88% with Caddie. A prompted Kimi K3 critic reaches only 29.13% in the same comparison. The acting model remains unchanged; reinforcement learning updates the advisor. ...

November 7, 2026 · 9 min · Zelina
Cover image

The Agent Scored Higher. What Actually Improved?

TL;DR for operators An AI agent can perform remarkably well on held-out benchmark questions without reliably solving the intended task. On LiveMath, an evolved agent answered all 53 held-out questions containing a recurring answer option correctly, but only 22 of the other 71. The recurring pattern provided a shortcut that survived into the supposedly independent evaluation. ...

October 31, 2026 · 8 min · Zelina
Cover image

When the Newest AI Skill Isn't the Best

TL;DR for operators An AI agent can fix one visual-reasoning failure and introduce another. As its instructions and tools evolve, operators need a way to distinguish genuine capability improvements from revisions that merely solve recent examples. They also need to diagnose recurring failures without repeatedly examining entire execution histories. VisualEvolve addresses both problems through versioned skill libraries and structured evidence retrieval. Across four frozen vision-language models and six evaluation sets, it improves over the initial skill library in 23 of 24 comparisons, with one tie. Removing historical version selection or structured evidence access substantially reduces performance. For organizations maintaining AI agents, the research supports treating skill revisions as evaluated, reversible artifacts rather than automatically accepting the latest changes. It does not yet establish enterprise reliability or lower total operating costs. ...

October 31, 2026 · 8 min · Zelina
Cover image

A Shorter Prompt Is Only as Safe as Its Test

TL;DR for operators Production-agent prompts can be shortened without a measurable decline in benchmark correctness, but the benchmark must first be trustworthy. A documented optimization failure removed important instructions while passing sampled checks, exposing a risk that aggregate scores can conceal. A new study addresses this through reproducible evaluation of agents connected to changing business data, followed by correctness-gated prompt optimization. Across three model families, it reports 3.5–7.6% reductions in the complete instruction surface, with a statistically significant correctness improvement for one family. ...

October 29, 2026 · 8 min · Zelina