Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference(cerebras.ai)
404 points by benchmarkist | 130 comments
Cerebras blog post announcing that Llama 3.1 405B runs at 969 tokens per second on its Cerebras Inference service.
#meta-llama on Hacker News
1 story tagged meta-llama, newest first.