Why MMAP in llama.cpp hides true memory usage(twitter.com)

95 points by flurly 3 years ago | 69 comments

In 2017, developers competed for who could create worst volume control interface(twitter.com)

103 points by rmason 3 years ago | 22 comments

Llama.cpp can do 40 tok/s on M2 Max, 0% CPU usage, using all 38 GPU cores(twitter.com)

40 points by samwillis 3 years ago | 9 comments

GPT4 is 8 x 220B params = 1.7T params(twitter.com)

322 points by georgehill 3 years ago | 167 comments

Tweet thread by swyx announcing a Latent Space podcast interview with George Hotz about tiny corp, including claims that GPT-4 is an 8x220B mixture model.

GitHub is investigating unauthorized access to their internal repositories(twitter.com)

527 points by splenditer 5 months ago | 289 comments

A post on X from GitHub stating it is investigating unauthorized access to its internal repositories, with no current evidence of impact to customer data.

Examples using Photoshop’s new “Generative Fill” feature(twitter.com)

272 points by olalonde 3 years ago | 163 comments