The Pile is a 825 GiB diverse, open-source language modelling data set(pile.eleuther.ai)299 points by bilsbie 2 years ago | 189 comments