Linear Is Not Invariant
TL;DR for operators If two parameterizations compute exactly the same model function, an interpretability conclusion presented as a property of that model needs a reason to remain valid when the internal coordinates change. The Linear Representation Hypothesis Needs a Group Action by Louie Hong Yao, Yuhao Li, and Shengchao Liu1 makes that requirement explicit. ...