Compression is prediction(ngrok.com)
611 points by nikolay | 252 comments
An ngrok blog post explaining compression basics and how data compressors and LLMs fundamentally solve the same prediction problem.
611 points by nikolay | 252 comments
An ngrok blog post explaining compression basics and how data compressors and LLMs fundamentally solve the same prediction problem.
107 points by snvzz | 22 comments
450 points by tosh | 304 comments
Short blog post by Simon Willison proposing the analogy that an LLM is a lossy encyclopedia, and advising users to supply correct examples rather than rely on recall.