Merge, Bound, and Determined: Why Weight-Space Surgery May Be CIL’s Most Underrated Trick
Opening — Why this matters now Class-Incremental Learning (CIL) remains one of the industry’s least glamorous yet most consequential problems. As enterprises deploy models in environments where data streams evolve—customer profiles shift, fraud patterns mutate, product catalogs expand—the question is simple: can your model learn something new without forgetting everything old? Most cannot. The paper Merge and Bound addresses this persistent failure not with exotic architectures or heavy replay buffers, but with an idea so pragmatic it feels subversive: manipulate the weights directly—merge them, constrain them, and let stability emerge from structure rather than brute-force rehearsal. fileciteturn0file0 ...