Click with Confidence: Teaching GUI Agents When *Not* to Click
Opening — Why this matters now Autonomous GUI agents are finally leaving demos and entering production. They book meetings, fill forms, manage dashboards—and occasionally approve payments they should not. The uncomfortable truth is that one mis-click can be irreversible. Yet most GUI grounding models behave with absolute confidence, even when they are guessing. The paper “SafeGround: Know When to Trust GUI Grounding Models via Uncertainty Calibration” tackles this exact failure mode. Its core argument is simple but sharp: progress in GUI agents is no longer bottlenecked by accuracy alone, but by the absence of calibrated doubt. ...