Running a 180B parameter LLM on a single Apple M2 Ultra (twitter.com) | HN Screenshots

YHacker Newsscreenshots

Screenshot of twitter.com: Running a 180B parameter LLM on a single Apple M2 Ultra

First screen, captured 3 years ago.

Looks similar

Screenshot of twitter.com: Why MMAP in llama.cpp hides true memory usage

Why MMAP in llama.cpp hides true memory usage (twitter.com)

95 points by flurly 3 years ago | 69 comments

Screenshot of twitter.com: A 94x speed improvement demonstrated using handwritten assembly

A 94x speed improvement demonstrated using handwritten assembly (twitter.com)

43 points by doener 2 years ago | 29 comments

Screenshot of twitter.com: Llama.cpp can do 40 tok/s on M2 Max, 0% CPU usage, using all 38 GPU cores

Llama.cpp can do 40 tok/s on M2 Max, 0% CPU usage, using all 38 GPU cores (twitter.com)

40 points by samwillis 3 years ago | 9 comments

Screenshot of twitter.com: Backdoor attempt on Exolabs GitHub repo through an innocent looking PR

Backdoor attempt on Exolabs GitHub repo through an innocent looking PR (twitter.com)

124 points by amrrs 1 year ago | 74 comments

Screenshot of twitter.com: Rp2040 runs unmodified PalmOS 5.2.8

Rp2040 runs unmodified PalmOS 5.2.8 (twitter.com)

84 points by mariuz 3 years ago | 19 comments

Screenshot of twitter.com: State-of-the-art open-source chatbot, Vicuna-13B, just released model weights

State-of-the-art open-source chatbot, Vicuna-13B, just released model weights (twitter.com)

241 points by weichiang 3 years ago | 113 comments