Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses(quesma.com)271 points by stared 1 month ago | 128 comments
Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs(baseten.co)215 points by philipkiely 1 year ago | 142 comments
Engineering of the fastest WebAssembly interpreters(wasmi-labs.github.io)124 points by herobird 1 month ago | 15 comments
Making AMD GPUs competitive for LLM inference (2023)(blog.mlc.ai)297 points by plasticchris 1 year ago | 199 comments
Making AMD GPUs competitive for LLM inference(blog.mlc.ai)302 points by djoldman 3 years ago | 106 comments