Spend the Next Byte Where It Repairs the Model
TL;DR for operators A deployment team can reach an awkward point after quantization: the checkpoint is small enough to ship, but quality is below target, and replacing the compression pipeline would mean another round of calibration, validation, packaging, and operational risk. The paper on Activation-Weighted Seeded Residual Coding, or AWSRC, asks whether some of that lost quality can instead be bought back with a small additional payload while leaving the existing low-bit reconstruction untouched.1 In its cleanest comparison, all tested residual codecs receive exactly 49,245,876 extra serialized bytes on the same RTN-SDQ parent. AWSRC reaches perplexity 7.04 and mean zero-shot accuracy 0.69—the best perplexity and a top accuracy result among the tested sparse, low-rank, learned-vector-quantized, and AWSRC repairs. Learned vector quantization has the best unrounded KL result, so the evidence supports a quality-per-byte advantage rather than dominance on every metric. ...