latent-space-podcast on Hacker News: 1 stories with screenshots

Screenshot of twitter.com: GPT4 is 8 x 220B params = 1.7T params

GPT4 is 8 x 220B params = 1.7T params (twitter.com)

322 points by georgehill 3 years ago | 167 comments

Tweet thread by swyx announcing a Latent Space podcast interview with George Hotz about tiny corp, including claims that GPT-4 is an 8x220B mixture model.

gpt-4 george-hotz tinygrad tiny-corp

#latent-space-podcast on Hacker News

GPT4 is 8 x 220B params = 1.7T params(twitter.com)

GPT4 is 8 x 220B params = 1.7T params (twitter.com)