Transformers Explained Visually(poloclub.github.io)
576 points by aray07 | 85 comments
Transformer Explainer is an interactive in-browser visualization that runs GPT-2 and shows how embeddings, multi-head self-attention, and MLP layers process text.
#gpt-2 on Hacker News
7 stories tagged gpt-2, newest first.
LLM from scratch, part 28 – training a base model from scratch on an RTX 3090(gilesthomas.com)
482 points by gpjt | 101 comments
Blog post, part 28 of a series, describing an experiment training a ~163M-parameter base LLM from scratch on a single RTX 3090 at home.
GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2(magazine.sebastianraschka.com)
450 points by ModelForge | 95 comments
Sebastian Raschka's Ahead of AI article analyzing the architecture of OpenAI's open-weight gpt-oss models, tracing changes since GPT-2 and comparing them to Qwen3.
Reproducing GPT-2 in llm.c(github.com)
578 points by tosh | 109 comments
A GitHub discussion in Andrej Karpathy's llm.c repository about reproducing GPT-2 training from scratch in C/CUDA.
Llm.c – LLM training in simple, pure C/CUDA(github.com)
810 points by tosh | 134 comments
GitHub repository for llm.c, Andrej Karpathy's project for training LLMs like GPT-2 in simple, raw C/CUDA.
Spreadsheets are all you need(spreadsheets-are-all-you-need.ai)
1409 points by evanmays | 160 comments
Landing page for a project that teaches how large language models work using a real LLM implemented entirely in Excel, with video lessons and a demo.
Language models can explain neurons in language models(openai.com)
659 points by mfiguiere | 416 comments
OpenAI research post describing using GPT-4 to automatically generate and score explanations of individual neuron behavior in GPT-2.