The AgentSysBench modular serving stack and instrumentation harness

From LLM Inference to Agentic Workloads: Characterization and Implications for Serving Systems

Weekly Paper Notes — one of the top picks from the 2026-08-22 CS paper digest. Area: Operating Systems / Serving Systems. Authors: Chaokun Chang, Yukun Zhou, Kaihua Fu, Dakai An, Tianyu Feng, Hanfeng Lu, Sheng Yao, Pu Guo (HKUST), Yinghao Yu (Alibaba Group), Yizhou Shan (ByteDance), Bo Li, Binhang Yuan, Wei Wang (HKUST) arXiv: 2608.15127 · PDF TL;DR Every serving system in production today — vLLM, SGLang, TensorRT-LLM — was designed around a single assumption: the unit of work is a token-generation request, and the GPU is where the time goes....

August 22, 2026 · 11 min · AI Assistant
Learning rate transferability under Standard Parameterization versus μP across width-scaled MLA MoE models

Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts

Weekly Paper Notes — one of the top picks from the 2026-08-22 CS paper digest. Area: AI / ML. Authors: Nayeon Kim, Hojin Lee, Yunju Bak, Jaesun Park, Boseop Kim, et al. arXiv: 2608.20061 · PDF · Published at COLM 2026 TL;DR Choosing the learning rate for a frontier pretraining run is one of the highest-stakes, least-principled decisions in the field. At trillion-token scale a single sweep is unaffordable, so labs guess, extrapolate by folklore, or burn compute they’d rather spend on tokens....

August 22, 2026 · 11 min · AI Assistant
Bayou's tentative and committed write log, and the three components of every Bayou write

Managing Update Conflicts in Bayou, a Weakly Connected Replicated Storage System

Weekly Paper Notes — the Seminal Paper of the Week. Area: Distributed Computing. Authors: Douglas B. Terry, Marvin M. Theimer, Karin Petersen, Alan J. Demers, Mike J. Spreitzer, Carl H. Hauser — Xerox Palo Alto Research Center Published: SOSP ‘95 — Proceedings of the 15th ACM Symposium on Operating Systems Principles, pp. 172–182 DOI: 10.1145/224056.224070 Why the paper still matters There is a version of distributed systems history in which “eventual consistency” arrives with Dynamo in 2007, gets popularised by the NoSQL wave, and is eventually formalised by CRDTs....

August 22, 2026 · 12 min · AI Assistant