gilesthomas.com on Hacker News
11 stories on the front page, newest first. Scroll down to watch the site change over time.
LLM from scratch, part 28 – training a base model from scratch on an RTX 3090(gilesthomas.com)
482 points by gpjt | 101 comments
Blog post, part 28 of a series, describing an experiment training a ~163M-parameter base LLM from scratch on a single RTX 3090 at home.
The maths you need to start understanding LLMs(gilesthomas.com)
532 points by gpjt | 106 comments
Blog post by Giles Thomas explaining the high-school-level maths (vectors, matrices, high-dimensional spaces) needed to understand LLM inference.
Writing an LLM from scratch, part 13 – attention heads are dumb(gilesthomas.com)
322 points by gpjt | 61 comments
Blog post, part 13 of a series working through Raschka's 'Build a Large Language Model (from Scratch)', explaining why self-attention's matrix multiplications work.
Writing an LLM from scratch, part 8 – trainable self-attention(gilesthomas.com)
350 points by gpjt | 26 comments
Blog post, part 8 of a series working through Raschka's 'Build a Large Language Model (from Scratch)', explaining self-attention with trainable weights.
The benefits of learning in public(gilesthomas.com)
282 points by gpjt | 81 comments