https://cognaptus.com/tags/attention-sinks/ Recent content in Attention Sinks on Cognaptus Hugo -- 0.145.0 en-us Fri, 06 Mar 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-03-06-when-tokens-explode-the-hidden-geometry-behind-attention-sinks/ Fri, 06 Mar 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-03-06-when-tokens-explode-the-hidden-geometry-behind-attention-sinks/ A mechanism-first reading of how massive activations, normalization, and attention-sink geometry interact inside modern Transformer language models.