A primer on GPUs and kernel optimization(nabo.dev)
175 points by nomi_uw | 15 comments
A blog post primer on GPU architecture, distributed computation, profiling, and kernel optimization, using examples from the author's Jam RL framework for LLMs.
1 story on the front page, newest first. Scroll down to watch the site change over time.
175 points by nomi_uw | 15 comments
A blog post primer on GPU architecture, distributed computation, profiling, and kernel optimization, using examples from the author's Jam RL framework for LLMs.