The Music Knob Needed a Feedback Loop
TL;DR for operators Music-generation interfaces usually want knobs: more bright, less dense, higher register, shorter phrases, something vaguely called “cinematic” because apparently we have not suffered enough. The problem is that a knob is not a controller. A knob sets a strength. A controller watches whether the system actually moved. The paper’s central contribution is Temporal PID for Sparse Activation Steering in symbolic music generation.1 The authors identify a specific failure mode: when Sparse Activation Steering tries to ramp gradually, small fractional interventions can be erased by the Sparse Autoencoder’s Top-K re-sparsification step. The product team thinks it asked for “a smooth transition.” The sparse representation hears: “nothing happened, carry on.” ...