When a Good Probe Points in Different Directions
TL;DR for operators A model can distinguish two behavioral concepts accurately without providing a reproducible internal measurement of either. In From Stories to Features, Scherbakov and colleagues1 address this problem by extracting concept directions from large collections of matched synthetic stories. Their 1,036-feature dictionary supports natural-text retrieval, controlled behavioral steering, and exploratory analysis of agent failures and jailbreak attacks. ...