Grokfast: Accelerated Grokking by Amplifying Slow Gradients (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Grokfast: Accelerated Grokking by Amplifying Slow Gradients

First screen, captured 2 years ago.

Looks similar

Screenshot of arxiv.org: CrunchGPT: A ChatGPT assisted framework for scientific machine learning

CrunchGPT: A ChatGPT assisted framework for scientific machine learning (arxiv.org)

59 points by occamschainsaw 3 years ago | 2 comments

Screenshot of arxiv.org: QLoRA: Efficient Finetuning of Quantized LLMs

QLoRA: Efficient Finetuning of Quantized LLMs (arxiv.org)

270 points by Garcia98 3 years ago | 90 comments

Screenshot of arxiv.org: Every model learned by gradient descent is approximately a kernel machine (2020)

Every model learned by gradient descent is approximately a kernel machine (2020)(arxiv.org)

157 points by Anon84 2 years ago | 111 comments

Screenshot of arxiv.org: Paper2Code: Automating Code Generation from Scientific Papers

Paper2Code: Automating Code Generation from Scientific Papers (arxiv.org)

122 points by Jerry2 1 year ago | 23 comments

Screenshot of arxiv.org: SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs

SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs (arxiv.org)

25 points by PaulHoule 1 year ago | 5 comments

Screenshot of arxiv.org: Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training

Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training (arxiv.org)

49 points by tosh 2 years ago | 2 comments