https://cognaptus.com/tags/feedforward-networks/ Recent content in Feedforward Networks on Cognaptus Hugo -- 0.145.0 en-us Sun, 07 Jun 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-06-07-moa-than-one-curve-teaching-ffns-to-choose-their-nonlinearity/ Sun, 07 Jun 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-06-07-moa-than-one-curve-teaching-ffns-to-choose-their-nonlinearity/ A mechanism-first reading of Mixture of Activations, and why token-adaptive nonlinearities may matter more than another round of parameter routing.