Optimizing ML training with metagradient descent(arxiv.org)79 points by ladberg 1 year ago | 13 comments
Grokfast: Accelerated Grokking by Amplifying Slow Gradients(arxiv.org)104 points by johnsutor 2 years ago | 31 comments
Provable Scaling Laws of Feature Emergence from Learning Dynamics of Grokking(arxiv.org)20 points by sva_ 1 year ago | 0 comments
Machine Learnability as a Measure of Order in Aperiodic Sequences(arxiv.org)41 points by PaulHoule 1 year ago | 4 comments
A Theory on Adam Instability in Large-Scale Machine Learning(arxiv.org)129 points by vov_or 3 years ago | 47 comments