GPT4 is 8 x 220B params = 1.7T params(twitter.com)
322 points by georgehill | 167 comments
Tweet thread by swyx announcing a Latent Space podcast interview with George Hotz about tiny corp, including claims that GPT-4 is an 8x220B mixture model.
#tiny-corp on Hacker News
2 stories tagged tiny-corp, newest first.
The tiny corp raised $5.1M(geohot.github.io)
554 points by super256 | 247 comments
George Hotz's blog post announcing that his new company, the tiny corp, raised $5.1M, and explaining its plan to sell AI computers and eventually chips.