https://sparsenotes.com/tags/ai-research/ Recent content in ai-research on Sparse Notes https://sparsenotes.com/images/og-default.png https://sparsenotes.com/images/og-default.png Hugo -- gohugo.io Sat, 23 May 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/05/transformer-vs-post-transformer/ Sat, 23 May 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/05/transformer-vs-post-transformer/ Notes from the Pathway-hosted 'Transformer vs Post-Transformer' panel — Łukasz Kaiser defending attention, with Adrian Kosowski (BDH/Pathway), Matthias Lechner (Liquid AI) and Llion Jones (Sakana AI) arguing for what comes next. Scaling laws, latent reasoning, hardware lock-in, benchmarks, and whether transformers themselves will discover their successor.