Cautious Optimizers: Improving Training with One Line of Code (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Cautious Optimizers: Improving Training with One Line of Code

First screen, captured 1 year ago.

Looks similar

Screenshot of arxiv.org: CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs

CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs (arxiv.org)

96 points by matt_d 5 months ago | 12 comments

Screenshot of arxiv.org: Self-Taught Optimizer (Stop): Recursively Self-Improving Code Generation

Self-Taught Optimizer (Stop): Recursively Self-Improving Code Generation (arxiv.org)

39 points by birriel 3 years ago | 8 comments

Screenshot of arxiv.org: SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs

SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs (arxiv.org)

25 points by PaulHoule 1 year ago | 5 comments

Screenshot of arxiv.org: Large Language Models as Optimizers. +50% on Big Bench Hard

Large Language Models as Optimizers. +50% on Big Bench Hard (arxiv.org)

89 points by og_kalu 3 years ago | 32 comments

Screenshot of arxiv.org: Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training

Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training (arxiv.org)

49 points by tosh 2 years ago | 2 comments

Screenshot of arxiv.org: AutoHete: An Automatic and Efficient Heterogeneous Training System for LLMs

AutoHete: An Automatic and Efficient Heterogeneous Training System for LLMs (arxiv.org)

41 points by PaulHoule 1 year ago | 0 comments