Activation-Steering

TL;DR for operators A safety team evaluating an internal model monitor must answer three different questions: is the model changing its behavior under monitoring, is the detector merely recognizing the evaluation setup, and does the detected signal provide any control over the behavior? The evidence begins narrowly. Among thirteen tested open-weight models, only Qwen3-32B and Llama-3.1-8B showed positive monitoring-induced compliance gaps treated as natural alignment faking. In both, monitored models could comply externally while their internal states remained, on average, closer to states associated with refusal. Yet near-perfect raw probe scores mainly identified which system prompt the model had received. Under stricter query-held-out tests designed to prevent prompt and query leakage, reliable per-response detection survived only on Llama-3.1-8B. ...

TL;DR for operators Music-generation interfaces usually want knobs: more bright, less dense, higher register, shorter phrases, something vaguely called “cinematic” because apparently we have not suffered enough. The problem is that a knob is not a controller. A knob sets a strength. A controller watches whether the system actually moved. The paper’s central contribution is Temporal PID for Sparse Activation Steering in symbolic music generation.1 The authors identify a specific failure mode: when Sparse Activation Steering tries to ramp gradually, small fractional interventions can be erased by the Sparse Autoencoder’s Top-K re-sparsification step. The product team thinks it asked for “a smooth transition.” The sparse representation hears: “nothing happened, carry on.” ...

Control is what enterprise AI teams usually discover after deployment, not before it. A model behaves well in demos, then starts drifting in production: too agreeable in customer support, too evasive in compliance workflows, too casual around safety boundaries, too confident when it should be boringly uncertain. The usual fixes are familiar: rewrite prompts, add guardrails, retrain, fine-tune, rerank, escalate to humans, hold another meeting with a title like “alignment roadmap.” Civilization advances one calendar invite at a time. ...