7 stories tagged speculative-decoding, newest first.
613 points by alphax314 | 183 comments
Blog post describing WorldTUI, a fine-tuned 360M-parameter language model that simulates a terminal by predicting screen updates from keypresses, with a browser demo.
41 points by gmays | 5 comments
Blog post by Joe Barrow explaining that speculative decoding speeds up LLM inference by changing the kind of GPU work rather than reducing FLOPs.
72 points by pptadversary | 11 comments
Blog post by Hayder Tirmazi describing optimizations that make prompt lookup drafting in llama.cpp up to 42x faster (140x with Daniel Lemire's follow-up PR) with less memory.
8 points by kunggaochicken | 0 comments
Show HN post for Jevgpt, a hobby autoregressive chatbot built from small-vocabulary token classifiers with a speculative decoding pass, linking to its GitHub repo.
![Screenshot of github.com: DSpark: Speculative decoding accelerates LLM inference [pdf]](https://hn.urlbox.com/shots/renders/2026/6/27/a78ab38d-2035-405d-90de-9fda7d61ca88.jpg)
771 points by aurenvale | 330 comments
GitHub file view of DSpark_paper.pdf in deepseek-ai's DeepSpec repo, a paper on speculative decoding to accelerate LLM inference.
464 points by kkm | 114 comments
A blog tutorial on running Gemma 4 and Qwen3.6 locally on macOS with llama.cpp, MTP speculative decoding, and multimodal support as a coding agent.
640 points by amrrs | 309 comments
Google blog post announcing Multi-Token Prediction drafters for Gemma 4 models to reduce inference latency and improve responsiveness.