Pruning Is a Game, and Most Weights Lose
Opening — Why this matters now Neural network pruning has always suffered from a mild identity crisis. We know how to prune—rank weights, cut the weakest, fine-tune the survivors—but we’ve been far less confident about why pruning works at all. The dominant narrative treats sparsity as a punishment imposed from outside: an auditor with a spreadsheet deciding which parameters deserve to live. ...