Cover image

When the Training Customer Is Too Helpful

TL;DR for operators A customer may withhold a preference, give an incomplete clarification, or change a requirement midway through a service conversation. A simulated customer that cooperates too readily can hide these difficulties. In the tau-bench comparison reported in MIMESIS: Learning User Simulators as Training Environments for Interactive Agents1, the same agent succeeds on 63.6% of tasks with real users, versus 82.4–84.4% with frontier API user simulators. ...

November 6, 2026 · 8 min · Zelina
Cover image

The Retry Is Not the Lesson: How ReTeach Learns from Failed Answers

TL;DR for operators A model generates an incorrect answer. An automated verifier can reject it but cannot explain the mistake. ReTeach1 shows how that failure can become training material without a worked solution or a larger external teacher. The model’s teacher revisits unsuccessful attempts, reflects on possible errors, and retries. But the successful retry is not simply copied into the student’s training targets. Instead, the teacher uses its additional reasoning context to produce better-informed token predictions along the student’s original response. The student learns from those predictions without needing that context itself. On SciKnowEval-Physics, explicit reflection achieves 64.24% accuracy, versus 62.91% with retries but no reflection (Section 4.3, Figure 4). ...

October 30, 2026 · 8 min · Zelina
Cover image

Confidence Is Not a Reranker

TL;DR for operators A reasoning model can have a useful estimate of how likely its current answer is to be correct without having enough information to reliably identify the best answer among several alternatives. That distinction is the central result of this paper. A lightweight classifier reading the model’s hidden state immediately before its final answer produces substantially better calibrated confidence than the model’s own stated score. Yet when that same signal is used to pick one answer from many sampled traces, its advantage over majority voting is small and remains far below the oracle that knows whether any candidate is correct. ...

October 17, 2026 · 8 min · Zelina
Cover image

Teach the Mismatch, Not the Whole Trace: Solver-Informed Self-Distillation for OR Models

TL;DR for operators An optimization assistant can generate executable solver programs for many business problems, but expert-verified formulations are expensive and a trajectory-level success signal does not reveal which modeling section was wrong. That makes solver execution useful not just as a final check, but as a potential source of training supervision. ...

October 3, 2026 · 7 min · Zelina
Cover image

ThinkSafe: Teaching Models to Refuse Without Forgetting How to Think

A model can be very good at solving math problems and very bad at saying no. That sentence sounds like a joke until it becomes a deployment problem. A reasoning model trained to work harder, think longer, and satisfy difficult prompts may also become more willing to satisfy harmful prompts. The training objective says: solve the problem. The model obeys. Safety, apparently, was not copied on the memo. ...

February 3, 2026 · 15 min · Zelina