The Pile: An 800GB dataset of diverse text for language modeling (2020) (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: The Pile: An 800GB dataset of diverse text for language modeling (2020)

First screen, captured 3 years ago.

Looks similar

Screenshot of arxiv.org: Chiplet ASIC supercomputers for LLMs like GPT-4

Chiplet ASIC supercomputers for LLMs like GPT-4 (arxiv.org)

128 points by kraken12 3 years ago | 54 comments

Screenshot of arxiv.org: Llemma: An Open Language Model for Mathematics

Llemma: An Open Language Model for Mathematics (arxiv.org)

239 points by AlphaWeaver 3 years ago | 43 comments

Screenshot of arxiv.org: Improving Text Embeddings with Large Language Models

Improving Text Embeddings with Large Language Models (arxiv.org)

31 points by cmcollier 2 years ago | 2 comments

Screenshot of arxiv.org: Scalable MatMul-Free Language Modeling

Scalable MatMul-Free Language Modeling (arxiv.org)

177 points by lykahb 2 years ago | 27 comments

Screenshot of arxiv.org: Scaling Data-Constrained Language Models

Scaling Data-Constrained Language Models (arxiv.org)

44 points by ijk 3 years ago | 5 comments

Screenshot of arxiv.org: Mistral 7B

Mistral 7B (arxiv.org)

228 points by fgfm 3 years ago | 101 comments