Accelerating Gemma 4: faster inference with multi-token prediction drafters(blog.google)
640 points by amrrs | 309 comments
Google blog post announcing Multi-Token Prediction drafters for Gemma 4 models to reduce inference latency and improve responsiveness.