Building Meta's GenAI infrastructure(engineering.fb.com)
636 points by mootpt | 291 comments
Meta engineering blog post describing its large GPU training clusters for generative AI, including RDMA and InfiniBand networking, Grand Teton hardware, and storage.