post-training

Slide tracing eras of scientific discovery from gentleman scientists to professionalized research

Who Gets to Be at the Frontier of Discovery

Weekly Video Notes — a short article distilling one talk from the weekly digest. Source video and key frames embedded throughout. Sara Hooker has done the full tour — PhD, DeepMind, several frontier labs, a research career built on efficiency at scale. Which is what makes this talk land: it’s an insider arguing that the system that produced her is an unreasonably narrow filter, and that the economics of the current moment are finally prying it open....

Slide contrasting Galactica's base-model demo with ChatGPT's RLHF pipeline

Scaling to Long Horizons: What Galactica Taught Us About RL

Most retellings of the modern AI wave start with ChatGPT arriving out of nowhere in November 2022. Ross Taylor has a different vantage point: he shipped a competing language model two weeks earlier, watched it get torn apart in public, and spent the following four years working out exactly why. This talk is the compressed version of that education — half war story, half technical agenda for what comes after the current generation of agents....

Charlie from Pause AI describing his 64–128 parallel agents working on KV-cache compaction

Running 128 Coding Agents at Once: Inside Cursor, Pause AI, and the Era of Agent Maxing

A short on-camera conversation between Sam Whitmore (engineer on Cursor’s cloud-agents team) and Charlie + Harry of Pause AI, recorded at Baseten and posted by Cursor as part of its agent-era publicity push. The framing is intentionally provocative — “I’ve got 64 to 128 agents working on this at any given time” — but the substance is closer to a workshop chat between three practitioners who actually live inside agent harnesses all day....