Distilling Step-by-Step Outperforming Larger Language Models with Less Training (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Distilling Step-by-Step Outperforming Larger Language Models with Less Training

First screen, captured 3 years ago.

Looks similar

Screenshot of arxiv.org: DiLoCo: Distributed Low-Communication Training of Language Models

DiLoCo: Distributed Low-Communication Training of Language Models (arxiv.org)

38 points by Anon84 2 years ago | 14 comments

Screenshot of arxiv.org: Scaling Data-Constrained Language Models

Scaling Data-Constrained Language Models (arxiv.org)

44 points by ijk 3 years ago | 5 comments

Screenshot of arxiv.org: Poisoning Language Models During Instruction Tuning

Poisoning Language Models During Instruction Tuning (arxiv.org)

70 points by hardmaru 3 years ago | 3 comments

Screenshot of blog.research.google: Outperforming larger language models with less training data and smaller models

Outperforming larger language models with less training data and smaller models (blog.research.google)

272 points by atg_abhishek 3 years ago | 99 comments

Screenshot of arxiv.org: Knowledge Distillation of Black-Box Large Language Models (2024)

Knowledge Distillation of Black-Box Large Language Models (2024)(arxiv.org)

115 points by babelfish 3 months ago | 22 comments

Screenshot of arxiv.org: SparseLoCo: Communication-Efficient LLM Training

SparseLoCo: Communication-Efficient LLM Training (arxiv.org)

11 points by synapz_org 1 year ago | 1 comments