When Circuits Go Atomic: Pruning Transformers One Neuron at a Time
The “important head” was never the whole story Audit. That is where many discussions about mechanistic interpretability become less romantic. It is pleasant to say that an AI model has “reasoning circuits.” It is less pleasant to ask which exact parts of the model must be preserved before a behavior survives, which parts are merely along for the ride, and which parts were called important only because our tools were too blunt to see inside them. ...