attention

Weekly Paper Notes — Seminal Paper of the Week for May 24–30, 2026. After a multi-week streak of systems classics (Raft, MapReduce, Lamport, ARIES), this week rotates to AI / ML. Authors: Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, Illia Polosukhin (Google Brain / Google Research / University of Toronto) Venue: NeurIPS 2017 arXiv: 1706.03762 · PDF Why this paper Picking Attention Is All You Need as a Seminal Paper of the Week in 2026 feels almost too on-the-nose — the Transformer is the architectural substrate underneath every frontier LLM, every modern diffusion model, every state-of-the-art protein folding system, every reasoning model whose chain-of-thought you have ever read....

Weekly Video Notes — a short article distilling one talk from the weekly digest. Source video and key frames are embedded throughout. 📜 Classic of the Week. This week’s digest re-surfaces a 2023 classic: Andrej Karpathy’s “Let’s build GPT: from scratch, in code, spelled out.” Three years later it is still, hands down, the clearest single resource for understanding what is actually happening inside a transformer. If you have never sat with it end-to-end, this is your nudge....