Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs (baseten.co) | HN Screenshots

YHacker Newsscreenshots

Screenshot of baseten.co: Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs

First screen, captured 1 year ago.

Looks similar

Screenshot of baseten.co: The efficient frontier of LLM inference

The efficient frontier of LLM inference (baseten.co)

137 points by philipkiely 1 month ago | 39 comments

Screenshot of blogs.nvidia.com: H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark

H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark (blogs.nvidia.com)

137 points by Anon84 3 years ago | 62 comments

Screenshot of gpuhammer.com: GPUHammer: Rowhammer attacks on GPU memories are practical

GPUHammer: Rowhammer attacks on GPU memories are practical (gpuhammer.com)

260 points by jonbaer 1 year ago | 89 comments

Screenshot of cerebras.ai: GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras

GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras (cerebras.ai)

20 points by samspenc 11 months ago | 12 comments

Screenshot of wasmi-labs.github.io: Engineering of the fastest WebAssembly interpreters

Engineering of the fastest WebAssembly interpreters (wasmi-labs.github.io)

124 points by herobird 1 month ago | 15 comments

Screenshot of qlabs.sh: NanoGPT Slowrun: 10x Data Efficiency with Infinite Compute

NanoGPT Slowrun: 10x Data Efficiency with Infinite Compute (qlabs.sh)

153 points by sdpmas 7 months ago | 36 comments