Why MMAP in llama.cpp hides true memory usage(twitter.com)

95 points by flurly 3 years ago | 69 comments

Llama.cpp can do 40 tok/s on M2 Max, 0% CPU usage, using all 38 GPU cores(twitter.com)

40 points by samwillis 3 years ago | 9 comments

When you combine two things that are close, but not the same(twitter.com)

120 points by tosh 3 years ago | 82 comments

HashiCorp just let go 8%(twitter.com)

147 points by ushakov 3 years ago | 144 comments

Substack Notes Launched(on.substack.com)

698 points by theolivenbaum 3 years ago | 196 comments

Substack CEO Chris Best's tweet thread announcing that Substack Notes, a short-form posting feature, is now available to everyone.

AI Generated Propaganda(twitter.com)

106 points by johndcook 3 years ago | 73 comments