Label Noise

TL;DR for operators Preference pipelines have an awkward failure mode: when an annotator accidentally chooses the worse of two responses, a standard preference loss can push hardest on exactly the pair the model ranks most strongly against the recorded label. A bad label can therefore receive unusually strong corrective force instead of being naturally ignored. ...

TL;DR for operators Hospitals do not label images the same way. Radiologists disagree on contours. Pathologists disagree on grades. Automatically generated masks miss structures, add structures, or quietly confuse one target for another. In centralized AI, those errors are already irritating. In federated learning, they become operationally awkward because the data cannot simply be pooled, inspected, cleaned, and morally forgiven by a heroic annotation team. ...