Sparse Training on Cognaptus

Sparse Training on Cognaptus https://cognaptus.com/tags/sparse-training/ Recent content in Sparse Training on Cognaptus Hugo -- 0.145.0 en-us Sat, 12 Sep 2026 00:00:00 +0000 MoEBlaze Cuts the Routing Buffers Behind the MoE Memory Wall https://cognaptus.com/blog/2026-09-12-moeblaze-cuts-the-routing-buffers-behind-the-moe-memory-wall/ Sat, 12 Sep 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-09-12-moeblaze-cuts-the-routing-buffers-behind-the-moe-memory-wall/ MoEBlaze shows that sparse MoE training can remain memory-bound unless routing buffers, activation lifetimes, and GPU data movement are redesigned together.