GPUs Go Brrr(hazyresearch.stanford.edu)
1056 points by nmstoker | 243 comments
Stanford Hazy Research blog post on what GPU hardware wants for efficient AI kernels, introducing the ThunderKittens CUDA kernel library.
1 story tagged flashattention, newest first.
1056 points by nmstoker | 243 comments
Stanford Hazy Research blog post on what GPU hardware wants for efficient AI kernels, introducing the ThunderKittens CUDA kernel library.