Eight Attempts, Four Routes, One Policy
TL;DR for operators A fixed budget of eight generated answers does not guarantee eight equally informative training experiences. Activation-Space Exploration (ASE), introduced by Zeng and colleagues,1 changes how those answers are generated by temporarily steering a model’s internal representations along directions learned from verified successes and failures. Against standard GRPO, ASE improves mathematical Mean@8 accuracy by 4.87 percentage points on Qwen3-1.7B and 1.87 points on Qwen3-8B, without increasing the eight-rollout training budget. Matched controls show that verifier-guided directions contribute beyond arbitrary steering. The intervention is used during training; the resulting model operates without it. ...