What happened to BERT and T5?(yitay.net)
218 points by fzliu | 63 comments
yitay.net on Hacker News
3 stories on the front page, newest first. Scroll down to watch the site change over time.
Training LLMs from ground zero as a startup(yitay.net)
360 points by swyx | 92 comments
Yi Tay's blog post on the experience of training large language models from scratch at a startup (Reka), covering compute, infrastructure, and lessons learned.