Scaling to Long Horizons: What Galactica Taught Us About RL
Most retellings of the modern AI wave start with ChatGPT arriving out of nowhere in November 2022. Ross Taylor has a different vantage point: he shipped a competing language model two weeks earlier, watched it get torn apart in public, and spent the following four years working out exactly why. This talk is the compressed version of that education — half war story, half technical agenda for what comes after the current generation of agents....