GigaGPT: GPT-3 sized models in 565 lines of code(cerebras.net)199 points by georgehill 2 years ago | 60 comments
SlimPajama: A 627B token cleaned and deduplicated version of RedPajama(cerebras.net)42 points by andyk 3 years ago | 2 comments