https://sparsenotes.com/series/weekly-papers-2026-11-07/ Recent content in weekly-papers-2026-11-07 on Sparse Notes https://sparsenotes.com/images/og-default.png https://sparsenotes.com/images/og-default.png Hugo -- gohugo.io Sat, 07 Nov 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/11/papers/eliminating-servers-state-machine-replication/ Sat, 07 Nov 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/11/papers/eliminating-servers-state-machine-replication/ UIUC and Wisconsin, with shared-log veteran Mahesh Balakrishnan, push state machine replication one step past disaggregation: the command log and a single materialized copy of state both live on blob storage, and clients cooperate to compact it. Their AirDB key-value store survives every server failure by having no servers, cold-starts 10–45× faster than server-based SMR, and costs about 22× less at low load. https://sparsenotes.com/posts/2026/11/papers/hinted-scaling-laws/ Sat, 07 Nov 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/11/papers/hinted-scaling-laws/ Stanford's fix for downstream scaling laws that break when small models score zero: show the model part of a reference solution, measure how accuracy rises with the hint, and fit one law over scale and hint level. Fit on models up to 10^20 FLOPs, it forecasts a 10^23 FLOP model's GSM8K score within 3 points, and it cuts median forecast error from 21 points to 4.3. https://sparsenotes.com/posts/2026/11/papers/backpropagation-rumelhart-hinton-williams-1986/ Sat, 07 Nov 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/11/papers/backpropagation-rumelhart-hinton-williams-1986/ Seminal paper of the week: a four-page Nature letter showed that gradient descent through hidden layers, computed with one forward and one backward pass, makes networks invent their own internal features. The 1986 paper didn't invent the chain rule or reverse-mode differentiation, but it showed what they could do and set off the field that became deep learning.