First screen, captured .
Looks similar
LLM from scratch, part 28 – training a base model from scratch on an RTX 3090(gilesthomas.com)
482 points by gpjt | 101 comments
Blog post, part 28 of a series, describing an experiment training a ~163M-parameter base LLM from scratch on a single RTX 3090 at home.
Writing an LLM from scratch, part 8 – trainable self-attention(gilesthomas.com)
350 points by gpjt | 26 comments
Blog post, part 8 of a series working through Raschka's 'Build a Large Language Model (from Scratch)', explaining self-attention with trainable weights.
Writing an LLM from scratch, part 13 – attention heads are dumb(gilesthomas.com)
322 points by gpjt | 61 comments
Blog post, part 13 of a series working through Raschka's 'Build a Large Language Model (from Scratch)', explaining why self-attention's matrix multiplications work.
The maths you need to start understanding LLMs(gilesthomas.com)
532 points by gpjt | 106 comments
Blog post by Giles Thomas explaining the high-school-level maths (vectors, matrices, high-dimensional spaces) needed to understand LLM inference.
Making a vintage LLM from scratch(crlf.link)
82 points by croqaz | 22 comments