SparseLoCo: Communication-Efficient LLM Training(arxiv.org)11 points by synapz_org 1 year ago | 1 comments
Apple MM1: Methods, Analysis and Insights from Multimodal LLM Pre-Training(arxiv.org)41 points by Anon84 2 years ago | 1 comments
Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training(arxiv.org)49 points by tosh 2 years ago | 2 comments
MM1: Methods, Analysis and Insights from Multimodal LLM Pre-training(arxiv.org)142 points by lord_sudo 2 years ago | 58 comments
SparseGPT: Language Models Can Be Accurately Pruned in One-Shot(arxiv.org)191 points by tosh 3 years ago | 54 comments