Reinforcement-Learning

TL;DR for operators SILO is a robotic cable-routing system built around a useful act of engineering restraint: it does not ask one model to grasp the cable, navigate the workspace, understand every deformation, avoid every collision, and execute directly on the physical controller. Instead, it divides the job among motion primitives, a localized reinforcement-learning policy, a compact perception system, and a simulator that remains active during deployment.1 ...

TL;DR for operators Production AI is usually evaluated as though one good model score can certify the entire system. It cannot. A model can be efficient because the task was structured intelligently, appear reliable because the test users were unusually cooperative, and still expose sensitive information through the infrastructure that serves it. ...

TL;DR for operators ABot-C0 is best understood as a behavior production system for quadruped robots, not as one giant model that accepts any instruction and directly controls every motor. It combines a 16,074-clip motion library, a generalist motion tracker, several specialized locomotion and interaction policies, and a deployment layer that decides which controller should be active. ...

TL;DR for operators Asynchronous RLHF buys throughput by allowing rollout workers to continue generating completions while the learner updates the policy. The invoice arrives later: some rollouts were generated by a policy that the learner has already left behind. The paper’s useful contribution is not merely the familiar observation that stale data can destabilize training. It identifies two different speed limits.1 ...

TL;DR for operators GRADE treats a collection of language models less like a brainstorming circle and more like an operations team with an unusually strict meeting policy. For each query, the system learns: how far the request should travel through the hierarchy; which expert agents should be activated; which agents should be allowed to read one another’s work; which branches should be discarded before the final answer is assembled. That restraint is the paper’s most important result. The winning configuration is not the one that activates every model and encourages maximum communication. Fixed three-agent routing beats fixed five-agent routing. Allowing every agent pair to communicate reduces MMLUPro accuracy by 2.1 points relative to the learned communication setting. Easy questions can bypass the expert pool entirely. ...

TL;DR for operators A system can discover agent “skills” that look coherent to humans and still fail to make an agent more capable. That is the useful result of Automating SKILL.md Generation for Computer-Using Agents via Interaction Trajectory Mining.1 The authors build a pipeline that cuts GUI interaction histories into segments, clusters those segments into candidate routines, generates explicit skill specifications, and trains a Qwen3-8B policy with Group Relative Policy Optimization, or GRPO, to compose the resulting skills. ...

TL;DR for operators A fixed rubric is a depreciating training asset. Early in reinforcement learning, it may be too demanding to distinguish one weak answer from another. Later, once the model learns to satisfy it, the same rubric becomes too easy. The score survives; the information content does not. EvoRubrics trains the evaluator alongside the model.1 A Policy LLM produces candidate answers, a Rubric Generator produces candidate evaluation criteria, and an external judge scores every answer against every rubric. The policy is rewarded for satisfying the evolving criteria. The rubric generator is rewarded for producing criteria that separate stronger from weaker answers, cover different dimensions, remain anchored to desired preferences, and help the policy revise its responses. ...

TL;DR for operators MaxProof is not primarily a story about a model suddenly becoming brilliant at mathematics. It is a story about wrapping an imperfect model in a disciplined production process. MiniMax trains M3 to perform three distinct jobs: write proofs, identify concrete errors in proofs, and repair proofs using those critiques. At inference time, MaxProof generates a population of candidate solutions, evaluates them conservatively, preserves competing approaches, applies both targeted patches and broader rewrites, and finally chooses one answer through pairwise comparison.1 ...

TL;DR for operators A new paper, Self-Paced Curriculum Reinforcement Learning for Autonomous Superbike Racing in Simulation, introduces a reinforcement-learning framework for training a superbike agent in VRider SBK, a Unity-based motorcycle racing simulator.1 The useful part is not merely that the model rides faster. The useful part is how the authors turn motorcycle racing into a staged learning problem without hand-writing a long curriculum by committee, which is usually how such things go to die politely. ...

TL;DR for operators A CAD assistant that writes code once and hopes for the best is not an engineering workflow. It is a raffle with syntax highlighting. IterCAD is interesting because it treats CAD generation and editing as an iterative operating loop: read the drawing, generate CadQuery code, execute it in a sandbox, inspect compiler and geometric feedback, revise, and stop only when the model has evidence that the shape is right.1 The paper’s practical contribution is not “AI can design parts now.” That would be the usual confetti cannon, and mercifully not the correct lesson. The better lesson is that useful CAD automation needs closed-loop verification, localized visual grounding, and evaluation metrics that count failures instead of quietly hiding them in the basement. ...