Meta's GB{2,3}00 Cluster(engineering.fb.com)
75 points by stokedmartin | 31 comments
Engineering at Meta blog post describing Prometheus, Meta's gigawatt-scale AI supercluster and the data center and networking work behind it.
#gpu-clusters on Hacker News
4 stories tagged gpu-clusters, newest first.
Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?
474 points by superasn | 304 comments
Ask HN thread asking how OpenAI serves ChatGPT to 700M weekly users when a GPT-4-class model is hard to run locally, seeking inference scaling insights.
How Meta trains large language models at scale(engineering.fb.com)
362 points by mfiguiere | 183 comments
Engineering at Meta blog post describing the software, hardware, and network considerations behind training large language models at scale in production.
Building Meta's GenAI infrastructure(engineering.fb.com)
636 points by mootpt | 291 comments
Meta engineering blog post describing its large GPU training clusters for generative AI, including RDMA and InfiniBand networking, Grand Teton hardware, and storage.