https://sparsenotes.com/tags/music-generation/ Recent content in music-generation on Sparse Notes https://sparsenotes.com/images/og-default.png https://sparsenotes.com/images/og-default.png Hugo -- gohugo.io Sat, 14 Nov 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/11/self-attention-generative-models-vaswani-huang/ Sat, 14 Nov 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/11/self-attention-generative-models-vaswani-huang/ Two years after 'Attention Is All You Need', Transformer co-author Ashish Vaswani explains to a Stanford class why self-attention works and what it costs, and Anna Huang shows how relative attention let the Music Transformer keep a motif going past its training length.