#nanochat on Hacker News

2 stories tagged nanochat, newest first.

LLM from scratch, part 28 – training a base model from scratch on an RTX 3090 (gilesthomas.com)

482 points by gpjt 10 months ago | 101 comments

Blog post, part 28 of a series, describing an experiment training a ~163M-parameter base LLM from scratch on a single RTX 3090 at home.

1409 points by huseyinkeles 1 year ago | 283 comments

GitHub repository for nanochat, Andrej Karpathy's minimal full-stack codebase for training and serving a small ChatGPT-like LLM for about $100.