Same Bit Budget, Different Image
TL;DR for operators Reducing numerical precision can make an image generator less computationally demanding, but where precision is retained can matter as much as the average bit-width. HGA-Quant1 addresses two decisions: which weight-reconstruction errors deserve protection, and which generation stages should receive higher-precision activations. On Infinity-2B, protecting early generation stages delivers an ImageReward score of 0.83523 at 5.5711 effective activation bits, compared with 0.44577 at 5.5543 bits when precision is concentrated late. Yet the same early-stage scheduling approach substantially worsens FlexVAR image quality. Aggressive weight-tail protection also fails under some extreme low-bit configurations. ...