https://cognaptus.com/tags/compute-allocation/ Recent content in Compute-Allocation on Cognaptus Hugo -- 0.145.0 en-us Sat, 12 Sep 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-09-12-scale-the-split-moe-compute-allocation-should-move-with-the-budget/ Sat, 12 Sep 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-09-12-scale-the-split-moe-compute-allocation-should-move-with-the-budget/ A new MoE scaling law suggests that teams should redesign the split between attention and expert computation as training budgets and sparsity change.