Tail Risk: Why Imbalanced AI Needs Shared Depth, Not Bigger Weights
TL;DR for operators Most business AI failures on imbalanced data do not look like dramatic model collapse. They look quieter: the system performs well on common cases, under-serves rare cases, and then someone discovers that “rare” was another word for “expensive when wrong”. The OSDTW paper tackles this long-tailed recognition problem by treating head and tail classes as two related tasks rather than one flattened classification problem.1 Its practical message is not “care more about minority classes”, although that would make a pleasant conference slogan. The message is sharper: imbalance is a structural design problem. You must decide which representation layers should be shared, which parts should specialise, and how much head versus tail supervision should shape the shared model. ...