Reasoning Models

Training a reasoning model sounds wonderfully modern until the model discovers that “being correct” and “looking correct enough to satisfy the reward” are not the same career path. That is the quiet problem behind reinforcement learning fine-tuning for large language models. The research conversation often treats methods like PPO, GRPO, and DAPO as a sequence of upgrades: first the classic algorithm, then the critic-free group method, then the decoupled-and-dynamically-sampled variant with a nicer acronym. Very tidy. Unfortunately, models do not read product positioning decks. ...

A customer sends a voice note, a screenshot, and a short complaint: “Why did your app charge me twice?” A weak AI assistant answers too fast and misses the evidence. A reasoning-heavy assistant thinks through everything, slowly, expensively, and occasionally performs a small philosophical opera over a billing issue. Neither is attractive. One is careless; the other is costly. The practical problem is not whether the model can reason. It is whether the model knows when reasoning is worth the bill. ...

Chess is useful because it is rude. It does not care whether a model writes elegant explanations. It does not reward confident prose. It does not politely accept a move that looks plausible but violates the rules. Either the move is legal, the position improves, and the game continues—or the model has just exposed something that a benchmark score on math or coding can easily hide. ...

An answer can look safe and still leave fingerprints. That is the uncomfortable point behind GuardTrace-VL: Detecting Unsafe Multimodel Reasoning via Iterative Safety Supervision.1 The paper is not merely saying that multimodal models can be unsafe. We knew that. Congratulations, the fire is hot. Its sharper claim is architectural: once a model reasons over both images and text, the safety problem no longer lives only at the input or the final answer. It also lives in the middle. ...

Review is cheap until it has to be correct. That is the uncomfortable lesson behind many agentic AI demos. A system writes an answer. A second model checks it. A third model fixes it. The workflow looks reassuringly managerial, like a tiny consulting firm trapped inside a GPU cluster. But the appearance of oversight is not the same thing as oversight. A weak reviewer can punish a good answer. A weak fixer can damage a nearly correct answer. And if the whole chain receives one final reward, reinforcement learning may end up congratulating the wrong participant. Very corporate, really. ...

A support ticket arrives. Then a compliance question. Then a spreadsheet formula request. Then a genuinely nasty piece of mathematical reasoning wearing the innocent expression of a homework problem. In too many AI systems, all four get sent to the same expensive reasoning model, because the architecture has the subtlety of a hotel buffet: everything goes through the same line. ...

Workflow software has a deeply unglamorous problem: reality keeps changing. A customer support agent may know the refund policy, but then the customer changes their address, the order record has a missing field, the tool returns a cryptic error, and the next API call requires a schema nobody mentioned in the demo. A spreadsheet agent may know how to summarise a table, but the file path is wrong, the calendar has a conflicting event, and the “obvious” action fails because the world, in its charmingly vindictive way, is not a benchmark prompt. ...

Tools are where agent demos go to die. The pitch is usually elegant. Give the model a goal, attach a few APIs, let it reason, and watch the automation glide across systems like a tiny consultant with no calendar conflicts. Then the real world appears: too many tools, unclear documentation, stale context, partial failures, long interaction histories, and the occasional API response that seems to have been designed by someone settling a personal score. ...

Meetings are already persuasive systems. Someone speaks first, someone sounds confident, someone produces a spreadsheet with just enough decimal places to look holy, and suddenly the room has moved. Multi-agent AI systems are not so different. They are becoming small artificial committees: one agent retrieves, another proposes, another critiques, another decides. The optimistic version says this gives us productive disagreement. The less adorable version says we have built a machine for circulating influence, and we are only now asking what makes one agent cave to another. ...

The dangerous part is often clearer after the model starts answering Moderation usually begins with the user’s prompt. That sounds sensible. Read the request, classify the risk, block the bad thing, let the good thing through. A tidy little border checkpoint, complete with imaginary clipboard. The problem is that jailbreaks are not polite enough to declare themselves at the border. ...