“Next-token predictor” is the wrong mental model for LLMs(gmcgoldr.github.io)

93 points by garrinm 1 month ago | 201 comments

Understanding GPT tokenizers(simonwillison.net)

380 points by simonw 3 years ago | 110 comments

Simon Willison blog post explaining how GPT tokenizers convert text to integer tokens, with an Observable notebook tool for encoding, decoding and searching tokens.

Show HN: AutoThink – Boosts local LLM performance with adaptive reasoning

386 points by codelion 1 year ago | 62 comments

Show HN post introducing AutoThink, a technique that adaptively allocates thinking tokens by query complexity and uses steering vectors to improve local LLM reasoning.

Smalltalk, Haskell and Lisp(storytotell.org)

103 points by todsacerdoti 1 year ago | 48 comments

Optimizing with Novel Calendrical Algorithms(jhpratt.dev)

21 points by mmastrac 1 year ago | 5 comments

Prompt caching for cheaper LLM tokens(ngrok.com)

268 points by samwho 10 months ago | 67 comments