https://sparsenotes.com/tags/nvlink/ Recent content in nvlink on Sparse Notes https://sparsenotes.com/images/og-default.png https://sparsenotes.com/images/og-default.png Hugo -- gohugo.io Sat, 03 Oct 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/10/papers/mixture-of-kittens-moe-megakernel-nvl72/ Sat, 03 Oct 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/10/papers/mixture-of-kittens-moe-megakernel-nvl72/ Cursor and Stanford rebuild MoE training for a 72-GPU NVLink domain: pull dispatch, push combine, a tunable overlap granularity, and a device-side ring buffer, all inside one deterministic megakernel. Up to 2.37x over the best public baseline, 1.41x end-to-end on 512 GB300s.