The Robot Finished the Task, but Not Your Way
TL;DR for operators A household robot can put an object in the correct place while ignoring instructions about how to handle it. A dashboard reporting only task completion would count that operation as successful, even when the user explicitly requested a different handling method. LIBERO-PeRM makes that discrepancy measurable. In one zero-shot evaluation, a vision-language-action model completed 97.50% of motion-preference tasks, yet its preference-satisfaction score was only 24.38%. Skill-preference tasks showed a similar gap: 100.00% task success against 25.00% satisfaction. ...