iPhone 17 Pro Demonstrated Running a 400B LLM(twitter.com)
689 points by anemll | 314 comments
An X post from @anemll showing a 400B-parameter MoE language model running locally on an iPhone at about 0.6 tokens per second via a Flash-MoE app.
689 points by anemll | 314 comments
An X post from @anemll showing a 400B-parameter MoE language model running locally on an iPhone at about 0.6 tokens per second via a Flash-MoE app.
16 points by cheviethai123 | 4 comments