Looks similar
Writing an LLM from scratch, part 8 – trainable self-attention(gilesthomas.com)
350 points by gpjt | 26 comments
Blog post, part 8 of a series working through Raschka's 'Build a Large Language Model (from Scratch)', explaining self-attention with trainable weights.
The maths you need to start understanding LLMs(gilesthomas.com)
532 points by gpjt | 106 comments
Blog post by Giles Thomas explaining the high-school-level maths (vectors, matrices, high-dimensional spaces) needed to understand LLM inference.






