10 stories tagged gpu-kernels, newest first.
14 points by handfuloflight | 15 comments
Homepage of Flapping Airplanes, an AI research startup working on model-system co-design and GPU megakernels to improve AI efficiency, listing its investors and funding.
187 points by anerli | 88 comments
GitHub repository for Magnitude, an open source Rust inference engine for local AI agents that autotunes GPU kernels to your hardware, claiming up to 2x faster than llama.cpp.
898 points by nonmaskable | 354 comments
NVIDIA Technical Blog post introducing CUDA Rust, describing two approaches for writing GPU kernels natively in Rust.
424 points by tosh | 91 comments
Blog post on using OpenAI Codex for automated research to optimize a kernel 232x faster; the captured page shows a Cloudflare verification screen.
426 points by bblcla | 78 comments
Blog post recounting how a training loss plateau turned out to be a PyTorch bug, traced through optimizer internals down to GPU kernels.
327 points by mmastrac | 143 comments
GitHub pull request in triton-lang/triton rewriting the Gluon attention tutorial kernel to be persistent, noting fp8 runs ~100 TFLOPS faster when the kernel name contains "cutlass".
472 points by sydriax | 94 comments
Stanford Hazy Research blog post introducing a throughput-optimized megakernel for tensor-parallel Llama-70B inference on H100 GPUs that overlaps compute, memory, and communication.
381 points by mfiguiere | 65 comments
GitHub repository for DeepSeek's DeepGEMM, a library of clean and efficient FP8 GEMM kernels with fine-grained scaling, released under the MIT license.
403 points by helloericsf | 105 comments
GitHub repository for DeepSeek's FlashMLA, an open-source MLA (multi-head latent attention) decoding kernel optimized for NVIDIA Hopper GPUs.
1056 points by nmstoker | 243 comments
Stanford Hazy Research blog post on what GPU hardware wants for efficient AI kernels, introducing the ThunderKittens CUDA kernel library.