TL;DR for operators A generative system can produce a fluent, factually plausible output and still fail because it focuses on the wrong information. Controllable Image Captioning with Prompt-Conditioned Scene Rewards by Jongyeop Hyun, Taeyoung Kim, and Hyounghun Kim1 tests a stricter approach: train the model not only to reward requested content, but also to penalize complementary content that falls outside the requested focus. ...
TL;DR for operators Music-generation interfaces usually want knobs: more bright, less dense, higher register, shorter phrases, something vaguely called “cinematic” because apparently we have not suffered enough. The problem is that a knob is not a controller. A knob sets a strength. A controller watches whether the system actually moved. The paper’s central contribution is Temporal PID for Sparse Activation Steering in symbolic music generation.1 The authors identify a specific failure mode: when Sparse Activation Steering tries to ramp gradually, small fractional interventions can be erased by the Sparse Autoencoder’s Top-K re-sparsification step. The product team thinks it asked for “a smooth transition.” The sparse representation hears: “nothing happened, carry on.” ...