6 stories tagged information-theory, newest first.
![Screenshot of youtube.com: Alan Kay: Shannon gave us a way of dealing with noisy channels [video]](https://hn.urlbox.com/shots/renders/2026/9/25/0001845e-5fb9-460a-ae07-41d25f64f264.jpg)
132 points by behoove | 24 comments
YouTube clip of Alan Kay at Kristen Nygaard's centenary symposium, caught in a delayed Zoom audio feedback loop while remarking on Shannon and noisy channels.
611 points by nikolay | 252 comments
An ngrok blog post explaining compression basics and how data compressors and LLMs fundamentally solve the same prediction problem.
451 points by samwho | 105 comments
A blog post analyzing the dating reality show "Are You the One?" mathematically, arguing contestants could reliably find all matches and win the prize money.
![Screenshot of cse.buffalo.edu: Essential Coding Theory [pdf]](https://hn.urlbox.com/shots/renders/2025/8/29/234dc011-71ad-4f38-8874-30d2ceb5edf2.jpg)
355 points by ibobev | 59 comments
PDF of the textbook "Essential Coding Theory" by Venkatesan Guruswami, Atri Rudra, and Madhu Sudan, dated August 26, 2025.
331 points by georgehill | 90 comments
Blog post by Isaac Liao and Albert Gu describing a method that solves ARC-AGI puzzles using lossless information compression without pretraining.
339 points by nsoonhui | 146 comments
Quanta Magazine article explaining entropy, 200 years after its introduction, as a measure of ignorance rather than an objective property of the world.