Packing is easy until one object is much larger than everything else. A warehouse can fit hundreds of ordinary boxes onto neatly spaced shelves. Add one grand piano, however, and the spacing plan becomes rather less elegant. Either the piano does not fit, or every shelf is redesigned around an object that appears once. ...
Compression needs a rulebook, not just a diet plan Compression is the least glamorous part of the LLM business until the bill arrives. A model works beautifully in a cloud demo. Then someone asks whether it can run on a device with limited memory, limited energy, limited connectivity, and limited patience. Suddenly the elegant system becomes a logistics problem. Quantize it. Prune it. Shrink it. Hope it still speaks like the original model and not like a sleep-deprived intern summarizing a legal contract from memory. ...
TL;DR for operators Quantizing an LLM is not a harmless cost-saving step. It changes the model, and the paper analysed here shows that those changes can weaken safety even when familiar utility scores still look respectable. That is the uncomfortable part: the dashboard can say “performance preserved” while the model has become more willing to comply with harmful requests. Very efficient. Very modern. Very easy to miss. ...