https://cognaptus.com/tags/hyperparameter-transfer/ Recent content in Hyperparameter-Transfer on Cognaptus Hugo -- 0.145.0 en-us Wed, 23 Sep 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-09-23-before-you-spend-10-trillion-tokens-separate-width-from-horizon/ Wed, 23 Sep 2026 00:00:00 +0000 https://cognaptus.com/blog/2026-09-23-before-you-spend-10-trillion-tokens-separate-width-from-horizon/ A two-step learning-rate transfer method shows how MoE training teams can reduce full-scale tuning compute by separating model-width transfer from token-horizon extrapolation.