Looks similar
Nanochat(simonwillison.net)
26 points by bilsbie | 4 comments
SmolLM2(simonwillison.net)
86 points by edward | 20 comments
Understanding GPT tokenizers(simonwillison.net)
380 points by simonw | 110 comments
Simon Willison blog post explaining how GPT tokenizers convert text to integer tokens, with an Observable notebook tool for encoding, decoding and searching tokens.






