The Mask Matters: Teaching AI What Not to See
Water is an unforgiving application domain. It does not care whether a model is fashionable, transformer-shaped, or blessed by a large parameter count. If a public agency needs warning of cyanotoxin risk, a model that is statistically elegant but physically confused is not “emergent intelligence.” It is a very expensive shrug. That is the useful provocation in SpecTM: Spectral Targeted Masking for Trustworthy Foundation Models.1 The paper does not argue that Earth-observation AI needs yet another larger model. Its sharper claim is that the training signal itself may be wrong. In masked image modeling, the model is usually trained by hiding random parts of the input and asking it to reconstruct them. This works impressively well in natural images, where missing pixels can often be inferred from texture, shape, and local continuity. Hyperspectral remote sensing is different. Some wavelengths are not just “pixels.” They are physical clues. ...