fsdp on Hacker News: 1 stories with screenshots

Fine tune a 70B language model at home (answer.ai)

821 points by jph00 2 years ago | 197 comments

Answer.AI blog post announcing an open source system combining FSDP and QLoRA to train a 70B language model on two 24GB consumer GPUs.