How many GPUs is 1M/B/T tokens?(cedana.com)
14 points by kmavm | 4 comments
Cedana's interactive calculator that converts a token volume and model choice into an estimated number of GPUs (e.g., H100s) needed to serve it.
#tokens on Hacker News
3 stories tagged tokens, newest first.
Cybersecurity looks like proof of work now(dbreunig.com)
531 points by dbreunig | 197 comments
Blog post by Drew Breunig arguing that with LLMs like Anthropic's Mythos, cybersecurity becomes a contest of spending more tokens than attackers, akin to proof of work.
Understanding GPT tokenizers(simonwillison.net)
380 points by simonw | 110 comments
Simon Willison blog post explaining how GPT tokenizers convert text to integer tokens, with an Observable notebook tool for encoding, decoding and searching tokens.