Cover image

A Better Policy Auditor Can Still Learn the Wrong Lesson

TL;DR for operators An AI agent can complete a customer request while violating an operational rule during execution. Testing the final answer alone may miss unauthorized state changes, missing confirmations, or disclosure failures. PROBE1 trains a smaller language model to discover such failures through multi-turn customer interactions. Its best trained auditors identify 55% of 20 policies under deterministic scoring, compared with 35% for a larger zero-shot auditor. Yet its original LLM-based verifier achieves only about 24% precision against human consensus, and the evaluated agents rarely reach consequential booking or cancellation operations. ...

November 15, 2026 · 8 min · Zelina