Keep the Rollout Honest: Miles Treats Throughput and Fidelity as One System
TL;DR for operators If rollout GPUs keep generating while training GPUs update the policy, higher utilization creates an accounting problem: some trajectories come from older weights, and serving and training stacks can assign different probabilities even when they nominally use the same model. The operating decision is therefore not simply how to remove idle time, but how much staleness and numerical mismatch the loop can tolerate. ...