Cover image

Same Answer, Different Risk: Visual Semantic Entropy for VLM Review Routing

TL;DR for operators A visual assistant gives the same confident answer several times. That consistency may seem sufficient for automatic acceptance, but it shows only that repeated decoding produced the same response—not that the underlying visual interpretation is stable. Variability can also come from the wrong place. When both the image and question wording are changed, paraphrase choice may drive the resulting answer clusters more strongly than the visual changes. In the paper’s joint-perturbation analysis, text purity exceeds image purity for every reported model and split. A high uncertainty score may therefore indicate prompt sensitivity rather than visual ambiguity. ...

July 26, 2026 · 10 min · Zelina
Cover image

Look Again Before You Answer: Visual RAG Needs a Search Policy

TL;DR for operators A visual support assistant shown an unfamiliar machine, product, bird, or venue cannot answer by retrieval alone. It must first determine what the image depicts, then locate the missing fact, while deciding whether another search is worth the delay. A wrong first match can redirect every later step toward the wrong entity. ...

July 23, 2026 · 8 min · Zelina