Scalable MatMul-Free Language Modeling (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Scalable MatMul-Free Language Modeling

First screen, captured 2 years ago.

Looks similar

Screenshot of arxiv.org: Language models as compilers: Simulating pseudocode execution

Language models as compilers: Simulating pseudocode execution (arxiv.org)

159 points by milliondreams 2 years ago | 49 comments

Screenshot of arxiv.org: Scaling Data-Constrained Language Models

Scaling Data-Constrained Language Models (arxiv.org)

44 points by ijk 3 years ago | 5 comments

Screenshot of arxiv.org: Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training

Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training (arxiv.org)

49 points by tosh 2 years ago | 2 comments

Screenshot of arxiv.org: Sorbet: A neuromorphic hardware-compatible transformer-based spiking model

Sorbet: A neuromorphic hardware-compatible transformer-based spiking model (arxiv.org)

47 points by PaulHoule 2 years ago | 24 comments

Screenshot of arxiv.org: TinyLlama: An Open-Source Small Language Model

TinyLlama: An Open-Source Small Language Model (arxiv.org)

113 points by matt1 2 years ago | 37 comments

Screenshot of arxiv.org: Ultra Fast Bert

Ultra Fast Bert (arxiv.org)

227 points by gyre007 2 years ago | 57 comments