iPhone 17 Pro Demonstrated Running a 400B LLM(twitter.com)
689 points by anemll | 314 comments
An X post from @anemll showing a 400B-parameter MoE language model running locally on an iPhone at about 0.6 tokens per second via a Flash-MoE app.
#flash-moe on Hacker News
1 story tagged flash-moe, newest first.