Whistle: Speech to Text in 16.9 MB(cactuscompute.com)
913 points by gmays | 176 comments
Cactus blog post announcing Whistle, a 16.9 MB open speech-to-text model for seven languages that runs on CPU alongside their Needle model.
#cactus on Hacker News
2 stories tagged cactus, newest first.
Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model(github.com)
712 points by HenryNdubuaku | 206 comments
GitHub repository for Needle, an MIT-licensed 26M-parameter function-calling model distilled from Gemini, designed to run on phones and other small devices.