How Meta trains large language models at scale(engineering.fb.com)
362 points by mfiguiere | 183 comments
Engineering at Meta blog post describing the software, hardware, and network considerations behind training large language models at scale in production.