How to Think About GPUs(jax-ml.github.io)
361 points by alphabetting | 107 comments
Part 12 of Google's "How To Scale Your Model" book, a deep dive into how NVIDIA GPUs work and are networked, and what that means for LLMs compared to TPUs.
361 points by alphabetting | 107 comments
Part 12 of Google's "How To Scale Your Model" book, a deep dive into how NVIDIA GPUs work and are networked, and what that means for LLMs compared to TPUs.
68 points by crowwork | 15 comments