arxiv

Weekly Paper Notes — one of the top picks from the 2026-08-15 CS paper digest. Area: AI / ML. Authors: Julian Minder, Viktor Moskvoretskii, Raghav Singhal (equal contribution), Difan Jiao, Andy Arditi, Shaobo Cui, Jannik Brinkmann, Ashton Anderson, Roland Aydin, Robert West, and others — EPFL, MATS, University of Toronto, Saarland University, Northeastern, SJTU, DFKI, Ontocord AI, Hereon/TUHH arXiv: 2608.13482 · PDF · Models & data TL;DR Every production language model today learns what the world is like during pretraining and only learns who it is supposed to be afterwards, during post-training....

Weekly Paper Notes — one of the top picks from the 2026-08-15 CS paper digest. Area: Operating Systems / Systems. Authors: Yuan Si (University of Waterloo), Yufeng Lin (Independent), Daming Li (Independent), Jialu Zhang (University of Waterloo, corresponding) arXiv: 2608.12103 · PDF TL;DR A trillion-parameter mixture-of-experts model routes each token through a small, input-dependent slice of its weights — in the production model studied here, an accepted token costs on average 1585 expert reads of 17....

Weekly Paper Notes — one of the top picks from the 2026-08-08 CS paper digest. Area: Distributed Computing / Computer Architecture. Authors: Jirong Yang, Peizhe Liu, Jovan Stojkovic (UT Austin); Chaojie Zhang (Microsoft Azure) arXiv: 2608.04458 · PDF TL;DR Datacenter servers have been optimized for two workload shapes: CPU-centric services (web serving, key-value stores, analytics) and monolithic LLM inference, where a GPU does dense tensor math and the host merely feeds it....

Weekly Paper Notes — one of the top picks from the 2026-08-08 CS paper digest. Area: Systems / Networking. Authors: Sarah McClure (UC Berkeley), Tegan Wilson (Northeastern), Brad Karp (UCL / Google), Michael Mitzenmacher (Harvard), Sylvia Ratnasamy (UC Berkeley), Scott Shenker (UC Berkeley / ICSI), Minlan Yu (Harvard) arXiv: 2608.01707 · PDF TL;DR Every large ML training system sits on one of two interconnect families: the fat-tree Clos that GPUs inherited from datacenter networking, or the torus that TPUs inherited from HPC....

Weekly Paper Notes — one of the top picks from the 2026-08-01 CS paper digest. Area: Systems / Networking. Authors: Evyatar Cohen, Jose Yallouz, Mark Silberstein, Isaac Keslassy (Technion); Alexander Shpiner (NVIDIA); Sylvia Ratnasamy, Isaac Keslassy (UC Berkeley) arXiv: 2607.26340 · PDF TL;DR Mixture-of-Experts models route each token to a small subset of experts, which turns every MoE layer into a highly skewed all-to-all communication phase across the GPU fabric....

Weekly Paper Notes — one of the top picks from the 2026-08-01 CS paper digest. Area: Operating Systems / Formal Methods. Authors: Qian Cheng, Ruize Tang, Yu Huang (Nanjing University); Saad Mohammad Rafid Pial, Yiming Su, Tianyin Xu (University of Illinois Urbana-Champaign); Emilie Ma, Finn Hackett, Ivan Beschastnikh (University of British Columbia) arXiv: 2607.25333 · PDF · Code TL;DR Formal verification of real systems has always been bottlenecked by the same thing: writing a good TLA+ specification takes a domain expert months, and the specification immediately begins drifting away from the code it describes....

Weekly Paper Notes — one of the top picks from the 2026-07-25 CS paper digest. Area: AI / ML (Agent Training). Authors: Xiao Yu, Baolin Peng, Ruize Xu et al. arXiv: 2607.21557 · PDF TL;DR Modern agents are shaped less by their base model and more by the harness wrapped around it — Claude Code, Codex, OpenClaw, GUI-use scaffolds. But those harnesses are stateful, multi-process, and full of tool orchestration, which means existing open SFT/RL stacks (veRL, TRL, OpenRLHF) can’t natively express a rollout inside one....

Weekly Paper Notes — one of the top picks from the 2026-07-25 CS paper digest. Area: NLP / LLM Inference. Author: Alagappan Valliappan arXiv: 2607.21535 · PDF TL;DR Frontier LLMs increasingly ship a built-in Multi-Token-Prediction (MTP / NEXTN) draft head for speculative decoding, based on the assumption that the draft is negligibly cheap. Windowed-MTP shows that assumption breaks catastrophically at million-token context: the native MTP head does full attention over the entire KV cache at every draft step, so its cost grows linearly with context and comes to dominate — precisely where speculation is supposed to matter most....

Weekly Paper Notes — one of the top picks from the 2026-07-11 CS paper digest. Area: AI / ML. Authors: Shreyas Subramanian, Adewale Akinfaderin, Akarsha Sehwag (Amazon) arXiv: 2607.08733 · PDF TL;DR “Super Weights” — individual scalar parameters in a large language model whose removal collapses task accuracy — were the interpretability finding of 2024–2025. The natural inference was that if these coordinates matter that much for the forward pass, they should also matter that much for learning: freeze everything else, train only the Super Weights (or a small neighbourhood around them), and you should get parameter-efficient fine-tuning for essentially free....

Weekly Paper Notes — one of the top picks from the 2026-07-11 CS paper digest. Area: Distributed Computing / Systems. Authors: Hannah Atmer, Thiemo Voigt, Yuan Yao, Stefanos Kaxiras (Uppsala University) arXiv: 2607.08407 · PDF TL;DR DRAM is the choke point of the current generative-AI buildout. HBM3e stacks are backordered, contract prices are up, and hyperscalers are absorbing a large fraction of global DRAM output just to fan the same model weights out to ever more accelerators....