Cover image

When the Benchmark Has Little to Mix

TL;DR for operators A forecasting team choosing between modeling each signal largely from its own history and building a system that mixes information across signals can reach very different conclusions depending on the benchmark it uses. In this paper, channel-independent models win all 10 standard multivariate time-series datasets by MSE. On a newly assembled benchmark containing more exploitable cross-channel structure, they win only 3 of 10.1 ...

October 9, 2026 · 7 min · Zelina
Cover image

Before the Test Comes the Question: The LLM Formulation Gap in Analytics

TL;DR for operators An analytics copilot can know statistics and still start from the wrong problem. StatFormBench tests what happens before statistical execution: given an informal request and heterogeneous data, can an LLM determine the statistical problem being asked, select the data objects that actually matter, and assign each one the correct analytical role? Across 1,013 human-reviewed scenarios and 14 LLMs, those abilities do not move together. Gemini 3.1 Pro achieves the highest fine-grained problem-classification accuracy at 72.0, while Claude Opus 4.6 achieves the highest variable-set overlap at 63.2. No evaluated model leads both components. ...

September 30, 2026 · 8 min · Zelina
Cover image

Name the Speaker, Then Ask the Plot: Selective Reasoning for Drama Transcripts

TL;DR for operators A streaming transcript can contain thousands of dialogue lines. Most are easy to assign to a speaker from the audio; the difficult minority consists of whispers, brief replies, crowded casts, and speech from outside the frame. DramaSR-LRM raises overall attribution accuracy from 85.49% to 87.79%. The average gain looks modest, but accuracy for utterances shorter than 0.5 seconds rises from 67.45% to 76.65%—precisely where acoustic evidence is most limited. ...

July 28, 2026 · 9 min · Zelina
Cover image

Calibrating Chaos: Stress-Testing AI Workflows Before Production Breaks Them

Upgrade day is when many AI systems quietly become different products. A model endpoint changes. A prompt is “cleaned up.” An orchestration library updates its defaults. A workflow that previously provisioned resources, checked permissions, deployed a service, and configured monitoring now produces something that looks almost the same. The words are familiar. The step count is close. The similarity score is high enough to let everyone continue their afternoon. ...

February 23, 2026 · 15 min · Zelina