Train the Advice, Not Just the Agent
TL;DR for operators A multi-step AI agent may retrieve useful information, lose track of a task constraint, or continue searching after it already has enough evidence. A separate advisor can recommend the next action, but asking a larger model for feedback does not guarantee that the advice will improve task completion. Caddie1 trains an advisor using what happens after the acting agent follows its suggestions. On MuSiQue with supplied passages, a Qwen3-4B agent improves from 21.56% success without assistance to 46.88% with Caddie. A prompted Kimi K3 critic reaches only 29.13% in the same comparison. The acting model remains unchanged; reinforcement learning updates the advisor. ...