Why MMAP in llama.cpp hides true memory usage(twitter.com)

95 points by flurly 3 years ago | 69 comments

Llama.cpp can do 40 tok/s on M2 Max, 0% CPU usage, using all 38 GPU cores(twitter.com)

40 points by samwillis 3 years ago | 9 comments

OpenAI API keys leaking through app binaries(twitter.com)

105 points by archiv 3 years ago | 59 comments

Ohio cryptic lineage update(twitter.com)

145 points by ano-ther 3 years ago | 102 comments

DirectX 12 Support on macOS(twitter.com)

247 points by doener 3 years ago | 93 comments

GitHub Copilot Chat Leaked Prompt(twitter.com)

817 points by marvinvonhagen 3 years ago | 98 comments

A Twitter thread by Marvin von Hagen sharing the leaked confidential system prompt rules of GitHub Copilot Chat, obtained via prompt injection.