AI Scaling

Budget meetings have a way of making AI theory suddenly less philosophical. Someone asks the simple question: “If we double the model size or the training data, how much better does the system get?” Then someone else opens a spreadsheet, adds a few curves, and everyone pretends the future has become manageable. This ritual has powered a large part of modern AI investment. Scaling laws made model development feel less like guesswork and more like engineering. ...

TL;DR for operators The paper’s headline is irresistible: consciousness as a jamming phase. It is also exactly the kind of headline that can make otherwise sensible people reach for a procurement memo and a philosophy degree at the same time. The useful reading is narrower and better. Kaichen Ouyang proposes a neural jamming phase diagram for language models, mapping three physical controls from jamming physics onto AI systems: effective temperature, volume fraction, and stress.1 In business terms, those become compute budget, model-and-data density, and training/deployment noise. The paper argues that generalisation may emerge when those controls push the model towards a critical surface where local representations become globally correlated. ...

TL;DR for operators The usual AI strategy story is simple: whoever spends the most on compute owns the future. The paper behind this article makes a more awkward claim: under current language-model scaling assumptions, massive compute advantage may be a temporary lead, not a permanent moat.1 The mechanism is not magic. It is diminishing returns. Chinchilla-like scaling laws imply that each additional unit of training compute buys a smaller reduction in loss. Meanwhile, hardware improvement and algorithmic progress are shared forces. They do not only help the largest labs. They also make yesterday’s “small” budget more capable. The result is a curve where frontier models pull ahead, peak in relative advantage, and then become less distinguishable from cheaper models. ...