https://cognaptus.com/tags/model-serving/ Recent content in Model Serving on Cognaptus Hugo -- 0.145.0 en-us Mon, 12 Jan 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-01-12-speculate-smarter-not-harder-hierarchical-decoding-without-regret/ Mon, 12 Jan 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-01-12-speculate-smarter-not-harder-hierarchical-decoding-without-regret/ A mechanism-first reading of Hierarchical Speculative Decoding, a lossless verifier that improves LLM inference speed by accepting more draft tokens without changing the target distribution.