Sparse-Autoencoders

TL;DR for operators Music-generation interfaces usually want knobs: more bright, less dense, higher register, shorter phrases, something vaguely called “cinematic” because apparently we have not suffered enough. The problem is that a knob is not a controller. A knob sets a strength. A controller watches whether the system actually moved. The paper’s central contribution is Temporal PID for Sparse Activation Steering in symbolic music generation.1 The authors identify a specific failure mode: when Sparse Activation Steering tries to ramp gradually, small fractional interventions can be erased by the Sparse Autoencoder’s Top-K re-sparsification step. The product team thinks it asked for “a smooth transition.” The sparse representation hears: “nothing happened, carry on.” ...

Scores are comforting. That is their main commercial advantage. A vendor can say its model reaches a certain accuracy on a benchmark, a leaderboard can rank systems neatly, and an internal AI team can report that the new model is “better” than the old one. Everyone gets a number. The procurement slide looks tidy. The risk committee, if mercifully sleepy, moves on. ...

TL;DR for operators This paper is not mainly about whether an LLM can forecast stock moves from news. That storyline is already crowded, noisy, and full of people discovering that backtests look unusually handsome when nobody has yet met execution costs. The more useful contribution is different: it shows a way to inspect and adjust the internal concepts an LLM activates while processing financial text. ...

TL;DR for operators Chain-of-thought prompting is often sold as a window into model reasoning. This paper is more useful because it treats CoT as something less mystical and more testable: a prompt-induced change in internal representations.1 The researchers train sparse autoencoders on hidden activations from two Pythia models solving GSM8K math problems under CoT and NoCoT prompts. They then patch CoT-derived sparse features into NoCoT runs and ask a sharper question: does inserting those internal features increase the log-probability of the correct answer? ...