Why MMAP in llama.cpp hides true memory usage(twitter.com)

95 points by flurly 3 years ago | 69 comments

Weird GPT-4 behavior for the specific string “ davidjl”(twitter.com)

233 points by goranmoomin 3 years ago | 190 comments

DirectX 12 Support on macOS(twitter.com)

247 points by doener 3 years ago | 93 comments

My total comp for creating GitHub Copilot(twitter.com)

108 points by FlamingMoe 3 years ago | 60 comments

HashiCorp just let go 8%(twitter.com)

147 points by ushakov 3 years ago | 144 comments

GPT4 is 8 x 220B params = 1.7T params(twitter.com)

322 points by georgehill 3 years ago | 167 comments

Tweet thread by swyx announcing a Latent Space podcast interview with George Hotz about tiny corp, including claims that GPT-4 is an 8x220B mixture model.