Control in Degrees: Why Reliable AI Needs Calibrated Intervention
TL;DR for operators Reliability is often treated as a binary control problem: approve or reject an agent action, preserve or replace a learned component. The evidence here points to a second question that can matter just as much: how strongly should the system intervene, where, and under what conditions? The clearest technical example comes from continual reinforcement learning. In a 400-million-step SlipperyAnt stress test, CPR recorded zero policy collapses across all 15 seeds under the paper’s main collapse criterion, while Adam and binary-reset baselines experienced collapses. Rather than fully replacing every selected component, CPR changes it by an amount tied to measured utility—preserving more useful learned state while refreshing low-utility state more aggressively. ...