https://cognaptus.com/tags/distributed-inference/ Recent content in Distributed-Inference on Cognaptus Hugo -- 0.145.0 en-us Fri, 11 Sep 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-09-11-sparse-is-not-cheap-by-default-what-moe-efficiency-actually-depends-on/ Fri, 11 Sep 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-09-11-sparse-is-not-cheap-by-default-what-moe-efficiency-actually-depends-on/ A sparse MoE model may activate far fewer parameters than it owns, but routing, capacity, communication, and deployment topology determine whether that sparsity becomes real system efficiency.