https://sparsenotes.com/tags/lecun/ Recent content in lecun on Sparse Notes https://sparsenotes.com/images/og-default.png https://sparsenotes.com/images/og-default.png Hugo -- gohugo.io Sat, 31 Oct 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/10/papers/platonic-representation-theorem-jepa/ Sat, 31 Oct 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/10/papers/platonic-representation-theorem-jepa/ Balestriero and LeCun prove that JEPAs trained separately on different modalities learn the same representation up to one rotation, provided their positive pairs are two observations of the same scene. Next-token prediction turns out to be a JEPA with bad views, and a 109M-parameter text JEPA aligns with vision encoders better than 72B language models.