Signal Over Noise: Why Multimodal RL Needs to Know What to Ignore
Audio. Video. Subtitles. The standard instinct is to send all of them into the model and hope the transformer performs its usual magic trick: turn a messy pile of signals into a useful answer. This instinct is understandable. It is also expensive, noisy, and occasionally a magnificent way to teach the model the wrong lesson. ...