Training LLMs for Honesty via Confessions(arxiv.org)56 points by arabello 10 months ago | 35 comments
SparseLoCo: Communication-Efficient LLM Training(arxiv.org)11 points by synapz_org 1 year ago | 1 comments
Optimizing ML training with metagradient descent(arxiv.org)79 points by ladberg 1 year ago | 13 comments
Self-Distillation Enables Continual Learning [pdf](arxiv.org)78 points by teleforce 5 months ago | 20 comments
QLoRA: Efficient Finetuning of Quantized LLMs(arxiv.org)270 points by Garcia98 3 years ago | 90 comments