Video Reasoning

TL;DR for operators A multimodal model can receive two exercise videos, describe both convincingly, and still fail to determine which person bent the relevant joint further. Apparently, seeing two videos is not the same as comparing them. A minor distinction, unless the product is marketed as a coach. MotionHalluc tests this gap using 1,540 questions constructed from 553 paired fitness videos. Its most revealing experiment simply reverses the query and reference videos while leaving the proposed corrective instruction unchanged. Several models that perform strongly in the expected order collapse when the order is reversed. LLaVA-OV-1.5-8B, for example, falls from 98.39% accuracy to 1.92%. ...

TL;DR for operators A room-tour video is a deceptively simple test for a video model. The objects do not explode, the camera does not enter a car chase, and nobody asks the model to perform cinematic philosophy. The hard part is duller and therefore more operationally relevant: the model must remember where things were, how rooms connected, what changed, and which earlier view matters now. ...

Raw Is Not Ready: Why Reliable AI Needs Evidence Architecture Production AI has entered its awkward teenage phase. It can speak fluently, see impressively, forecast usefully, and still fail in ways that make operators quietly reach for the manual override. The problem is not simply that models are too small, not enough tokens have been burned, or someone forgot to add “think step by step” to a prompt. The deeper problem is that many AI systems are being asked to reason directly from raw inputs that have not yet been converted into the right operational form. ...