Knowing the Scene Is Not Knowing When to Speak
TL;DR for operators An always-on assistant must recognize when help is needed, provide the correct assistance before the opportunity passes, and remain silent otherwise. Strong audiovisual question-answering performance does not establish these capabilities. The Omni-Life benchmark evaluates twelve real-time omnimodal model configurations across 400 everyday-life videos. The highest Full Correct score is 4.48%, against a 53.10% human baseline. One model achieves 78.25% accuracy on explicit content questions but only 3.42% recall of required interventions during streaming. ...