https://sparsenotes.com/tags/parsing/ Recent content in parsing on Sparse Notes https://sparsenotes.com/images/og-default.png https://sparsenotes.com/images/og-default.png Hugo -- gohugo.io Sat, 17 Oct 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/10/accelerating-the-zig-tokenizer-avx512-niles-salter/ Sat, 17 Oct 2026 00:00:00 +0000 https://sparsenotes.com/posts/2026/10/accelerating-the-zig-tokenizer-avx512-niles-salter/ Niles Salter shows how bit-parallel tricks (subtract, count-trailing-zeros, vector compaction, ternary logic) turn a branchy byte-at-a-time tokenizer into a branchless one, taking Zig source tokenization from about 0.5 GB/s to about 2 GB/s on one core.