Inside vLLM: Anatomy of a High-Throughput LLM Inference System (2025)(aleksagordic.com)127 points by sebg 2 months ago | 8 comments
How to optimize a CUDA matmul kernel for cuBLAS-like performance (2022)(siboehm.com)86 points by mpweiher 2 years ago | 21 comments
Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs(baseten.co)215 points by philipkiely 1 year ago | 142 comments
What happens when a GPU writes memory(blog.doubleword.ai)61 points by ibobev 1 month ago | 1 comments