llama-70b on Hacker News: 1 stories with screenshots

Screenshot of hazyresearch.stanford.edu: We bought the whole GPU, so we're damn well going to use the whole GPU

We bought the whole GPU, so we're damn well going to use the whole GPU (hazyresearch.stanford.edu)

472 points by sydriax 1 year ago | 94 comments

Stanford Hazy Research blog post introducing a throughput-optimized megakernel for tensor-parallel Llama-70B inference on H100 GPUs that overlaps compute, memory, and communication.

megakernels llm-inference tensor-parallelism llama-70b

#llama-70b on Hacker News

We bought the whole GPU, so we're damn well going to use the whole GPU(hazyresearch.stanford.edu)

We bought the whole GPU, so we're damn well going to use the whole GPU (hazyresearch.stanford.edu)