Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference(cerebras.ai)
404 points by benchmarkist | 130 comments
Cerebras blog post announcing that Llama 3.1 405B runs at 969 tokens per second on its Cerebras Inference service.
#llama-3-1 on Hacker News
1 story tagged llama-3-1, newest first.