Every model learned by gradient descent is approximately a kernel machine (2020)(arxiv.org)157 points by Anon84 2 years ago | 111 comments
Grande: Gradient-Based Decision Tree Ensembles(arxiv.org)7 points by PaulHoule 3 years ago | 0 comments
Grokfast: Accelerated Grokking by Amplifying Slow Gradients(arxiv.org)104 points by johnsutor 2 years ago | 31 comments
No More Adam: Learning Rate Scaling at Initialization Is All You Need(arxiv.org)84 points by jinqueeny 1 year ago | 23 comments
Graph Neural Networks use graphs when they shouldn't(arxiv.org)112 points by Pseudomanifold 3 years ago | 20 comments