#hazy-research on Hacker News

2 stories tagged hazy-research, newest first.

Screenshot of hazyresearch.stanford.edu: We bought the whole GPU, so we're damn well going to use the whole GPU

We bought the whole GPU, so we're damn well going to use the whole GPU (hazyresearch.stanford.edu)

472 points by sydriax 1 year ago | 94 comments

Stanford Hazy Research blog post introducing a throughput-optimized megakernel for tensor-parallel Llama-70B inference on H100 GPUs that overlaps compute, memory, and communication.

megakernels llm-inference tensor-parallelism llama-70b

Screenshot of hazyresearch.stanford.edu: GPUs Go Brrr

GPUs Go Brrr (hazyresearch.stanford.edu)

1056 points by nmstoker 2 years ago | 243 comments

Stanford Hazy Research blog post on what GPU hardware wants for efficient AI kernels, introducing the ThunderKittens CUDA kernel library.

gpu-kernels thunderkittens cuda flashattention

#hazy-research on Hacker News

We bought the whole GPU, so we're damn well going to use the whole GPU(hazyresearch.stanford.edu)

GPUs Go Brrr(hazyresearch.stanford.edu)

We bought the whole GPU, so we're damn well going to use the whole GPU (hazyresearch.stanford.edu)

GPUs Go Brrr (hazyresearch.stanford.edu)