Bonsai 27B: A 27B-Class model that runs on a phone(prismml.com)
649 points by xenova | 230 comments
PrismML blog post announcing Bonsai 27B, a 27B-parameter-class language model designed to run locally on a phone.
#mobile-inference on Hacker News
1 story tagged mobile-inference, newest first.