https://cognaptus.com/tags/llm-pretraining/ Recent content in LLM-Pretraining on Cognaptus Hugo -- 0.145.0 en-us Fri, 11 Sep 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-09-11-more-flops-worse-choice-sparse-moe-scaling-has-to-price-the-cluster/ Fri, 11 Sep 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-09-11-more-flops-worse-choice-sparse-moe-scaling-has-to-price-the-cluster/ MOSAIC shows why sparse-MoE architecture decisions should price the useful computation a real cluster can deliver, not model FLOPs alone.