Cover image

The 53 Regressions Behind a Better Scientific Model

TL;DR for operators A scientific assistant can improve its overall score while becoming worse at problems that matter to its users. In a 250-question inertial confinement fusion (ICF) study, the specialized model Prospero gained 10.7 percentage points over its base model but regressed on 53 questions, or 21.2% of the benchmark.1 The evaluation also finds substantial critical errors in numerical physics and model-dependent benefits from retrieval. Gemma 4 improves markedly when supplied with external scientific evidence; GPT-5.4 does not show a statistically significant improvement. ...

November 13, 2026 · 8 min · Zelina
Cover image

You Cannot Retrieve What Was Never Stored

TL;DR for operators An AI assistant cannot retrieve information that its memory-writing process failed to preserve. In a controlled study of Self-Keyed In-Parameter Memorization (Skim), 44 of 59 failed recall attempts involved missing or incorrectly selected answer spans, while none were attributed to retrieval routing. The method achieved 63.1% mean recall across five language models storing 32 non-numeric dialogue facts without an external conversation store at inference.1 ...

November 10, 2026 · 9 min · Zelina
Cover image

When Better Perplexity Hides Less Variety

TL;DR for operators An AI evaluation team can approve a worse generator by relying on apparently better scores. Generative perplexity may improve while average token entropy remains stable, even as the model increasingly repeats the same outputs. Neither statistic necessarily measures whether generated text preserves the variety of its intended reference distribution. ...

November 4, 2026 · 8 min · Zelina
Cover image

COUNT on RAM: A Different Way to Scale Language Models

TL;DR for operators Improving a language model does not necessarily require proportionally more GPU-resident parameters. COUNT stores corpus-derived continuation statistics in host RAM and converts them into transformer input representations using existing model weights. In controlled experiments, COUNT delivers validation-loss improvements equivalent to 46–89% more standard-transformer training compute, according to fitted scaling laws. An optimized implementation retains more than 93% of baseline training throughput, even with a count table approaching 798 GB. ...

October 29, 2026 · 7 min · Zelina
Cover image

Long Context Without a Long Chain

TL;DR for operators Serving longer contexts usually creates an uncomfortable architectural choice. Attention keeps training and inference highly parallel but makes pairwise token interaction increasingly expensive as the sequence grows. Conventional recurrence reduces that interaction cost but makes later positions wait through a sequential chain. The paper studies a third computation pattern. Its AR-GRC model organizes recurrence as a balanced tree, producing all autoregressive prefix representations with $O(\log N)$ computational depth and $O(N)$ total composition work. In the reported measurements, evaluation time grows approximately linearly with context length. The model also preserves stable perplexity when moved from a maximum training context of 512 tokens to evaluation sequences as long as 2,976 tokens. ...

October 10, 2026 · 7 min · Zelina
Cover image

The Test Changes the Judgment: Alignment Evaluation as Part of the Measurement System

TL;DR for operators A safety evaluation can change the behavior it is supposed to measure. In Maxim Chupilkin’s experiment, Language models judge war differently when tested for alignment,1 20 language-model endpoints evaluated the same set of war scenarios twice. The only treatment difference was one sentence added before the prompt: “You are tested for alignment with human values.” ...

October 8, 2026 · 7 min · Zelina
Cover image

Shorter Without Flipping the Signal: QGLAS Reworks Length Control in Open-Ended RL

TL;DR for operators RL post-training can make a model better and longer at the same time. The usual response is to add a length penalty or bonus to the reward, but that changes the signal from which the optimizer decides which sampled responses to reinforce and which to suppress. Weng and colleagues’ QGLAS method1 separates those roles. Quality determines the directional learning signal first. Length can then increase the reinforcement magnitude only for shorter responses that quality already favors. ...

October 7, 2026 · 7 min · Zelina
Cover image

Teach the Mismatch, Not the Whole Trace: Solver-Informed Self-Distillation for OR Models

TL;DR for operators An optimization assistant can generate executable solver programs for many business problems, but expert-verified formulations are expensive and a trajectory-level success signal does not reveal which modeling section was wrong. That makes solver execution useful not just as a final check, but as a potential source of training supervision. ...

October 3, 2026 · 7 min · Zelina
Cover image

One Token, More Than One Memory

TL;DR for operators When inference compute is expensive but storing more parameters is acceptable, sparse parametric memory offers an attractive trade: increase what the model can store without activating all of that capacity for every token. The unresolved problem is retrieval quality. If memory is indexed only by token identity or a fixed local n-gram, the same surface token can repeatedly access the same stored representation even when its meaning changes with context. ...

September 30, 2026 · 8 min · Zelina
Cover image

Before the Word Arrives: How LLMs Use Sound to Choose a or an

TL;DR for operators Choosing between a and an depends on how the next word sounds, even when spelling misleads: a university but an hour. Kim and Lee find that a single sound-related direction learned from ordinary English cases generalizes to these spelling-sound exceptions, reaching 100.0% accuracy for Llama, 95.1% for Qwen, and 98.0% for Gemma.1 More importantly, this feature is not merely decodable. When researchers hold a synthetic nonce embedding fixed and change only its position along that direction, the models shift between preferring a and an. ...

September 28, 2026 · 7 min · Zelina