https://sparsenotes.com/tags/vision-language-models/ Recent content in vision-language-models on Sparse Notes https://sparsenotes.com/images/og-default.png https://sparsenotes.com/images/og-default.png Hugo -- gohugo.io Sat, 14 Nov 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/11/papers/unbundling-multimodal-vision-encoding/ Sat, 14 Nov 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/11/papers/unbundling-multimodal-vision-encoding/ Meta FAIR and NYU split the vision encoder into three separate design choices (a pretrained prior, dedicated vision parameters, and placement before fusion) and test each one with every model trained from scratch at matched compute. Only the dedicated parameters matter, and they work just as well as vision-only branches inside the first eight layers of the language model.