Raven architecture: a client engine talks gRPC to the catalog service (ERQL transpiler), which reads and writes catalog metadata and edge logs in the metadata store; a separate garbage collector with a graph store and in-memory graph engine consumes the edge logs.

Raven: Towards Unified File Management for Data Lakehouse Systems

Weekly Paper Notes — one of the top picks from the 2026-11-14 CS paper digest. Area: Databases. Authors: Keonwoo Oh (University of Maryland), Akshay Mehra (Dolby Labs), Joshua Kimball (Dolby Labs), Amol Deshpande (University of Maryland) arXiv: 2611.15975 · PDF · Code · Submitted to ICDE 2027 TL;DR Lakehouse metadata sits at one of two extremes. Open table formats (Iceberg, Delta Lake, Hudi) write everything as files next to the data....

November 14, 2026 · 11 min · AI Assistant
Three panels. Pretrained versus scratch encoder: separate pretraining is optional. Encoder-free versus scratch encoder: dedicated vision capacity is key. Pre-fusion versus in-fusion capacity: vision capacity can move in-fusion.

Unbundling Multimodal Vision Encoding

Weekly Paper Notes — one of the top picks from the 2026-11-14 CS paper digest. Area: AI / ML. Authors: Ellis Brown, Chris Hoang (equal contribution), Shengyi Qian, Shang-Wen Li, Mike Lewis, Marjan Ghazvininejad, Luke Zettlemoyer, Lucas Beyer, Mengye Ren, Jakob Verbeek, Saining Xie, Hu Xu (Meta FAIR, New York University) arXiv: 2611.17334 · PDF · Project page TL;DR Most vision-language models bolt a separately pretrained image encoder (CLIP, SigLIP and relatives) onto a language model....

November 14, 2026 · 10 min · AI Assistant
Three SMR architectures. Conventional: clients talk to servers that run consensus and hold materialized state. Disaggregated: servers hold state but the log is on external storage. Serverless (S2MR): clients talk directly to external storage holding both the log and a single copy of state.

Eliminating Servers in State Machine Replication

Weekly Paper Notes — one of the top picks from the 2026-11-07 CS paper digest. Area: Distributed Computing / Databases. Authors: Dohyun Park (UIUC), Wenjie Hu (UW–Madison), Xiangyao Yu (UW–Madison), Mahesh Balakrishnan (Meta; work done prior), Yongjoo Park (UIUC) arXiv: 2611.01363 · PDF TL;DR State machine replication (SMR) is how etcd, ZooKeeper, Spanner, CockroachDB and their relatives keep state consistent: agree on a total order of commands, then have servers apply them....

November 7, 2026 · 8 min · AI Assistant
Top: a benchmark turned into easier versions by truncation, masking, or logit mixing at hint level H. Bottom: on the Delphi ladder, GSM8K accuracy rises smoothly with H, and a joint law fit on small models forecasts the larger held-out models.

Hinted Scaling Laws

Weekly Paper Notes — one of the top picks from the 2026-11-07 CS paper digest. Area: AI / ML. Authors: Suze van Adrichem, Luke Bailey, Rohith Kuditipudi (equal contribution), Christine Ye, Neil Band, Ahmed Ahmed, John Duchi, Percy Liang, Tatsunori Hashimoto (Stanford University) arXiv: 2611.02270 · PDF · Code TL;DR Scaling laws on pretraining loss work. Scaling laws on benchmark accuracy mostly don’t, because the small models you can afford to train score zero on hard benchmarks, and a row of zeros gives you no trend to extrapolate....

November 7, 2026 · 7 min · AI Assistant
MetaDB cluster architecture: clients talk to stateless proxies, which consult MetaCache and a Manager for routing, then forward to backend nodes running Raft groups over an in-memory MVCC layer and a RocksDB key-value engine.

MetaDB: Putting File-System Structure Back into Distributed Databases

Weekly Paper Notes — one of the top picks from the 2026-10-31 CS paper digest. Area: Databases. Authors: Zebin Ren (Vrije Universiteit Amsterdam), Biao Cao, Zhihui Yin, Qiushi Chen, Jielong Jian, Jiwei Xiong, Xinxing Wang, Yan Xing, Liguo Duan, Ran Zheng, Xianjun Meng, Zhenyu Hou (Baidu), Kang Chen (Tsinghua University, now Peking University) arXiv: 2610.32247 · PDF TL;DR Most large storage systems now keep their namespace in a distributed database: Facebook’s Tectonic on ZippyDB, Google’s Colossus on Bigtable, HopsFS on NDB....

October 31, 2026 · 11 min · AI Assistant
Left: one world observed as images and as texts, with good views (two photos, two captions) making an image JEPA and a text JEPA equal up to one rotation. Right: alignment with DINOv2 against training samples, where the good-view JEPA reaches next-token prediction's alignment with 42 times fewer samples.

Proving and Improving the Platonic Representation Hypothesis with JEPAs

Weekly Paper Notes — one of the top picks from the 2026-10-31 CS paper digest. Area: AI / ML. Authors: Randall Balestriero (Brown University, AMI Labs), Yann LeCun (NYU, AMI Labs) arXiv: 2610.39302 · PDF TL;DR In 2024 Huh, Cheung, Wang and Isola observed that vision models and language models trained separately end up with increasingly similar representations as they scale, and conjectured that they converge on a shared statistical model of reality....

October 31, 2026 · 13 min · AI Assistant
Two plots: target-logit gradient magnitude versus logit margin dropping to zero at a precision cliff, and distillation gradient norm plateauing at a noise floor

A Fix for Softmax and Cross-Entropy

Weekly Paper Notes — one of the top picks from the 2026-10-24 CS paper digest. Area: AI / ML. Authors: Jonathan T. Barron, Dan Gnanapragasam, Michael Tschannen (Google DeepMind) arXiv: 2610.31642 · PDF TL;DR Every deep learning framework computes softmax and cross-entropy the same way: subtract the largest logit so exp can’t overflow, then normalise. That trick fixes overflow and leaves two quieter bugs in place. The first, which the authors call Softmax Collapse, hits when the model is very confident....

October 24, 2026 · 11 min · AI Assistant
AI-greement harness: protocol knowledge base, modular consensus skeleton, and Lean verification framework, connected by a researcher-developer-verifier loop

The End of Consensus Research?

Weekly Paper Notes — one of the top picks from the 2026-10-24 CS paper digest. Area: Distributed Computing. Authors: Clément Burgelin, Rachid Guerraoui, Zicong Hong, Yinan Hu, Anne-Marie Kermarrec, Rafael Pires, Rasmus Moorits Veski, Martijn de Vos (EPFL; alphabetical order) arXiv: 2610.30114 · PDF TL;DR The title asks a question and the last section answers it: “Our answer is no; this is just a new beginning.” The EPFL distributed computing group asks whether a coding agent can produce a practical new consensus protocol: designed, implemented, benchmarked under geo-replication, crash-tested and proved safe....

October 24, 2026 · 12 min · AI Assistant
Overview of Context Language Models: emergent context edits, results on BrowseComp-Plus and Software World, steering and skill evolution, and RL

Context Language Models

Weekly Paper Notes — one of the top picks from the 2026-10-03 CS paper digest. Area: NLP. Authors: Rulin Shao, Shannon Zejiang Shen, Junjie Oscar Yin, Yuetai Li, Minheng Wang, Hamish Ivison, Radha Poovendran, Nathan Lambert, Teng Xiao, Mike Lewis, Wen-tau Yih, Luke Zettlemoyer, Pang Wei Koh (University of Washington, Meta Superintelligence Labs, MIT, Trillium Labs) arXiv: 2609.37725 · PDF · Code TL;DR A standard language model’s context only grows: each turn appends the model’s output, c_{t+1} = c_t ⊕ f(c_t)....

October 3, 2026 · 10 min · AI Assistant
MoK overview: communication SMs pull tokens into a macrobatch ring buffer, compute SMs run expert FFNs, outputs are pushed back

Mixture-of-Kittens: MoE Megakernel for NVL72s

Weekly Paper Notes — one of the top picks from the 2026-10-03 CS paper digest. Area: Distributed Computing. Authors: Stuart H. Sul, Nash Brown (Stanford, Cursor Research), Henry Wildermuth, William Lin, Federico Cassano (Cursor Research), Christopher Ré (Stanford) arXiv: 2609.36070 · PDF · Code TL;DR Mixture-of-Kittens (MoK) is the MoE training kernel Cursor uses to train Composer on GB300 NVL72 racks. The paper’s opening finding is uncomfortable for anyone who has invested in MoE communication libraries: on a 72-GPU NVLink domain, existing expert-parallel systems built for InfiniBand often lose to a naive PyTorch + NCCL baseline, and in nearly half of the evaluated configurations the naive baseline beats every alternative....

October 3, 2026 · 11 min · AI Assistant