https://sparsenotes.com/tags/jepa/ Recent content in jepa on Sparse Notes https://sparsenotes.com/images/og-default.png https://sparsenotes.com/images/og-default.png Hugo -- gohugo.io Sat, 29 Aug 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/08/papers/levjepa-video-pretraining/ Sat, 29 Aug 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/08/papers/levjepa-video-pretraining/ Replacing EMA target encoders and predictors with a provable anti-collapse regularizer lets a single video encoder match V-JEPA 2 at 5.6–20.8x less compute — and discarding 95% of tokens improves accuracy rather than degrading it.