![Screenshot of youtube.com: Let's Build the GPT Tokenizer [video]](https://hn.urlbox.com/shots/renders/2024/2/20/3a4e4c3f-c4ce-4d7d-967c-d91df03c18b1.jpg)
Let's Build the GPT Tokenizer [video](youtube.com)
585 points by davidbarker | 42 comments
YouTube video lecture by Andrej Karpathy building the GPT tokenizer (byte-pair encoding) from scratch in a Jupyter notebook.
#byte-pair-encoding on Hacker News
1 story tagged byte-pair-encoding, newest first.