Replit's new Code LLM: Open Source, 77% smaller than Codex, trained in 1 week(latent.space)

848 points by swyx 3 years ago | 214 comments

Latent Space podcast episode with Replit's Reza Shabani about training Replit's open-source code LLM in one week and evaluating it.

The AI Content Flippening(latent.space)

31 points by swyx 3 years ago | 36 comments

The state of silicon and the GPU poors(latent.space)

73 points by swyx 2 years ago | 34 comments

How to Train a Million Context LLM(latent.space)

9 points by 7d7n 2 years ago | 1 comments

The Mathematics of Training LLMs(latent.space)

171 points by FanaHOVA 3 years ago | 58 comments

Why Google failed to make GPT-3(latent.space)

25 points by bookofjoe 2 years ago | 11 comments