Scaling Data-Constrained Language Models (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Scaling Data-Constrained Language Models

First screen, captured 3 years ago.

Looks similar

Screenshot of arxiv.org: Scalable MatMul-Free Language Modeling

Scalable MatMul-Free Language Modeling (arxiv.org)

177 points by lykahb 2 years ago | 27 comments

Screenshot of arxiv.org: Llama 2 Long

Llama 2 Long (arxiv.org)

108 points by apsec112 3 years ago | 23 comments

Screenshot of arxiv.org: Scaling Latent Reasoning via Looped Language Models

Scaling Latent Reasoning via Looped Language Models (arxiv.org)

73 points by remexre 9 months ago | 12 comments

Screenshot of arxiv.org: Scaling Transformer to 1M tokens and beyond with RMT

Scaling Transformer to 1M tokens and beyond with RMT (arxiv.org)

232 points by panabee 3 years ago | 115 comments

Screenshot of arxiv.org: Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training

Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training (arxiv.org)

49 points by tosh 2 years ago | 2 comments

Screenshot of arxiv.org: Poisoning Language Models During Instruction Tuning

Poisoning Language Models During Instruction Tuning (arxiv.org)

70 points by hardmaru 3 years ago | 3 comments