Cover image

Topics Without Coordinates: What CALLIOPE Gains, and What It Costs

TL;DR for operators A company analyzing thousands of support conversations needs categories that explain what customers are discussing without exposing their individual messages. Conventional systems commonly group numerical representations of messages, then generate descriptions for the resulting clusters. But geometric similarity does not necessarily produce the most informative topic labels. CALLIOPE1 offers an alternative: LLMs recursively summarize documents, synthesize categories from aggregated keywords, and assign records to those categories without embedding-based clustering. Its private version provides a formal document-level differential-privacy guarantee for released topic hierarchies. ...

October 31, 2026 · 9 min · Zelina
Cover image

The Label Is Too Late: EduBehaviors Makes Conversation Coding Auditable

TL;DR for operators A conversation-analysis system can return the wrong label for at least two different reasons: it may have misunderstood what happened in the conversation, or it may have correctly recognized the behavior and then mapped it incorrectly to the construct being measured. A single LLM label hides that distinction. EduBehaviors1 separates the two steps. The system first records human-readable yes-or-no judgments about observable behaviors, then uses a separate rule or classifier to convert those judgments into the final label. In the paper’s Teacher TalkMoves evaluation, the word-only baseline reached macro-F1 0.339 and Cohen’s kappa 0.328. The strongest reported assertion-based configuration reached macro-F1 0.673 with kappa 0.688. ...

October 8, 2026 · 7 min · Zelina