Seeing Is Not Thinking: Teaching Multimodal Models Where to Look
Opening — Why this matters now Multimodal models can answer visual questions with alarming confidence. They can also be catastrophically wrong while sounding perfectly reasonable. The uncomfortable truth is that many vision–language models succeed without actually seeing what matters. They talk first. They look later—if at all. The paper behind LaViT puts a name to this failure mode: the Perception Gap. It is the gap between saying the right thing and looking at the right evidence. And once you see it quantified, it becomes hard to ignore. ...