Groq runs Mixtral 8x7B-32k with 500 T/s(groq.com)
739 points by tin7in | 431 comments
Groq's homepage, showcasing its fast LLM inference service running Mixtral 8x7B at around 500 tokens per second; the capture shows only a logo splash.
3 stories tagged mixtral, newest first.
739 points by tin7in | 431 comments
Groq's homepage, showcasing its fast LLM inference service running Mixtral 8x7B at around 500 tokens per second; the capture shows only a logo splash.
589 points by georgehill | 272 comments
Mistral AI announcement post introducing Mixtral, a high-quality sparse mixture-of-experts language model.
463 points by xyzzyrz | 199 comments
A Mistral AI post on X sharing a BitTorrent magnet link to download the weights of its Mixtral 8x7B 32k-context model.