Merge, Bound, and Determined: Why Weight-Space Surgery May Be CIL’s Most Underrated Trick
Catalogs change. Defect categories change. Fraud patterns change. Document types change. The model, unfortunately, often reacts like an employee who learns the new product line and immediately forgets where the old shelves are. That is the everyday problem behind Class-Incremental Learning (CIL): a model must learn new classes over time while still recognizing old ones. The difficult part is not merely adding output labels. It is keeping the feature extractor from being rewritten by the latest task until yesterday’s knowledge becomes decorative archaeology. ...