Flash-MoE: Running a 397B Parameter Model on a Laptop(github.com)
379 points by mft_ | 119 comments
GitHub repository for Flash-MoE, a project for running a 397B-parameter mixture-of-experts model on a laptop using Metal inference code.
#apple-metal on Hacker News
2 stories tagged apple-metal, newest first.
An appeal to Apple from Anukari(anukari.com)
347 points by humbledrone | 174 comments
A devlog post from the Anukari developer appealing to Apple's Metal team for help making the app's GPU performance reliable across Apple silicon Macs.