datacenter

Weekly Paper Notes — one of the top picks from the 2026-08-08 CS paper digest. Area: Distributed Computing / Computer Architecture. Authors: Jirong Yang, Peizhe Liu, Jovan Stojkovic (UT Austin); Chaojie Zhang (Microsoft Azure) arXiv: 2608.04458 · PDF TL;DR Datacenter servers have been optimized for two workload shapes: CPU-centric services (web serving, key-value stores, analytics) and monolithic LLM inference, where a GPU does dense tensor math and the host merely feeds it....

Weekly Paper Notes — one of the top picks from the 2026-08-01 CS paper digest. Area: Systems / Networking. Authors: Evyatar Cohen, Jose Yallouz, Mark Silberstein, Isaac Keslassy (Technion); Alexander Shpiner (NVIDIA); Sylvia Ratnasamy, Isaac Keslassy (UC Berkeley) arXiv: 2607.26340 · PDF TL;DR Mixture-of-Experts models route each token to a small subset of experts, which turns every MoE layer into a highly skewed all-to-all communication phase across the GPU fabric....

Weekly Video Notes — a short article distilling one talk from the weekly digest. Source video and key frames are embedded throughout. Dwarkesh Patel got an unusually concrete tour of a working AI training facility this week: Jane Street’s GB300 NVL72 cluster in Texas, guided by Ron Minsky (co-head of the technology group) and Daniel Pontecorvo (physical engineering). It’s only 16 minutes long, but it’s a dense walk through the things that actually break when you try to put modern GPU racks into a building that was never designed for them — cooling, leak detection, power balancing, and miles of copper and fiber....