LFM2.5-24B-A2B: Built for fast on-device agents(liquid.ai)
271 points by gmays | 72 comments
Liquid AI blog post announcing LFM2.5-24B-A2B, a sparse language model with about 2B active parameters designed for fast on-device agents.
#on-device-ai on Hacker News
35 stories tagged on-device-ai, newest first.
We turned EmbeddingGemma 2 into a speech-to-text model(eg2.haku.sh)
404 points by amrrs | 86 comments
Landing page for Embedding Gemma Transcribe, a free macOS app that adapts Google's EmbeddingGemma 2 into an on-device speech-to-text model.
Show HN: Free open source Adobe Lightroom alternative, completely local with AI(github.com)
37 points by thesnarkitecht | 34 comments
GitHub repository for Rembrandt, a free open source photo editor with RAW support, masks and on-device AI for macOS, Windows and Linux.
Whistle: Speech to Text in 16.9 MB(cactuscompute.com)
913 points by gmays | 176 comments
Cactus blog post announcing Whistle, a 16.9 MB open speech-to-text model for seven languages that runs on CPU alongside their Needle model.
Tell HN: Apple not letting removal of AI models on macOS 27 is outrageous
8 points by busymom0 | 0 comments
A Tell HN post complaining that macOS 27 keeps about 30 GB of Apple Intelligence models on disk even when Siri/AI is disabled, with no way to remove them.
Google EmbeddingGemma 2(twitter.com)
7 points by hmokiguess | 1 comments
Google Gemma's X post announcing EmbeddingGemma 2, a 740M-parameter multimodal on-device embedding model with 8K context and Apache 2.0 license.
EmbeddingGemma 2: An open, lightweight multimodal embedding model(blog.google)
395 points by ilreb | 42 comments
Google blog post announcing EmbeddingGemma 2, an open lightweight on-device model that embeds text, images, audio, and video into a unified space.
MicroLLM Lab – Try 7 tiny LLM's in the browser(stateofutopia.com)
271 points by logicallee | 99 comments
MicroLLM Lab is a browser-based tool for running, chatting with, and benchmarking small quantized language models locally via WebGPU with no server.
Desert Ant Labs: local, fast models that run on device(desertant.com)
472 points by willwhitedc | 97 comments
Launch blog post from Desert Ant Labs introducing the company and its fast, local AI models designed to run on device.
New Mac Studio with M5 Max and M5 Ultra(apple.com)
805 points by interpol_p | 535 comments
Apple Newsroom press release announcing a new Mac Studio with M5 Max and M5 Ultra chips, up to 512GB unified memory, aimed at local AI and pro workflows.
Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows(research.meta.ai)
1156 points by riordan | 624 comments
Meta blog post announcing Muse Glimmer, an open 30B-parameter agentic model designed to run locally on devices for always-on agent workflows.
Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac(github.com)
845 points by gitpusher42 | 300 comments
GitHub repo for TurboFieldfare, a Swift/Metal inference engine running 4-bit Gemma 4 26B-A4B on M-series Macs in about 2 GB RAM by streaming experts from SSD.
Bonsai 27B: A 27B-Class model that runs on a phone(prismml.com)
649 points by xenova | 230 comments
PrismML blog post announcing Bonsai 27B, a 27B-parameter-class language model designed to run locally on a phone.
Apple Core AI Framework(developer.apple.com)
335 points by hmokiguess | 96 comments
Apple developer documentation for Core AI, a beta framework for building, running, and deploying AI models in apps on Apple silicon across CPU, GPU, and Neural Engine.
Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency(blog.google)
384 points by theanonymousone | 120 comments
Google blog post announcing Gemma 4 models trained with Quantization-Aware Training to cut memory use and improve on-device performance on mobile and laptops.
Gemma 4 12B: A unified, encoder-free multimodal model(blog.google)
1007 points by rvz | 379 comments
Google blog post announcing Gemma 4 12B, an encoder-free multimodal model designed to run on laptops with mobile-first efficiency and advanced reasoning.
1-Bit Bonsai Image 4B Image Generation for Local Devices(prismml.com)
438 points by modinfo | 186 comments
PrismML blog post announcing Bonsai Image 4B, a 1-bit and ternary quantized image generation model designed to run on local devices.
What Apple and Google are doing to push notifications(jacquescorbytuech.com)
392 points by iamacyborg | 389 comments
Blog essay by Jacques Corby-Tuech on how Apple and Google have increasingly intervened in and filtered push notifications, drawing parallels with email.
Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model(github.com)
712 points by HenryNdubuaku | 206 comments
GitHub repository for Needle, an MIT-licensed 26M-parameter function-calling model distilled from Gemini, designed to run on phones and other small devices.
Chrome removes claim of On-device Al not sending data to Google Servers(old.reddit.com)
532 points by newsoftheday | 201 comments
Reddit r/chrome thread about Chrome removing a claim that its on-device AI does not send data to Google servers; the page was blocked by Reddit's network policy.
Google Chrome silently installs a 4 GB AI model on your device without consent(thatprivacyguy.com)
1603 points by john-doe | 1060 comments
Blog post by Alexander Hanff arguing Google Chrome silently downloads a 4 GB Gemini Nano AI model without consent, raising privacy, legal and climate concerns.
Apple's accidental moat: How the "AI Loser" may end up winning(adlrocha.substack.com)
347 points by walterbell | 302 comments
Substack essay arguing Apple, seen as an AI laggard, may win through its hardware and on-device advantage as frontier AI models become commoditized.
Gemma 4 on iPhone(apps.apple.com)
829 points by janandonly | 226 comments
Dutch App Store listing for Google AI Edge Gallery, a free iPhone app for running on-device LLMs like Gemma 4 for chat, image questions, and agent skills.
Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs(prismml.com)
385 points by PrismML | 144 comments
Homepage of PrismML, a startup building ultra-dense, compact AI models such as its 1-bit Bonsai LLMs for smartphones and efficient datacenters.
Ensu – Ente’s Local LLM app(ente.com)
346 points by matthiaswh | 154 comments
Ente's blog post announcing the first release of Ensu, an offline app for running LLMs locally on your device with full privacy and control.
Show HN: Three new Kitten TTS models – smallest less than 25MB(github.com)
510 points by rohan_joshi | 169 comments
GitHub repository for KittenTTS, an open-source series of tiny text-to-speech models (80M, 40M, 14M parameters) designed to run on-device without a GPU.
MacBook Pro with M5 Pro and M5 Max(apple.com)
812 points by scrlk | 874 comments
Apple Newsroom press release announcing MacBook Pro models with M5 Pro and M5 Max chips, faster SSDs, and 1TB starting storage.
Pocket TTS: A high quality TTS that gives your CPU a voice(kyutai.org)
594 points by pain_perdu | 142 comments
Kyutai blog post introducing Pocket TTS, a 100M-parameter text-to-speech model with voice cloning that runs in real time on a laptop CPU.
Gemma 3 270M: Compact model for hyper-efficient AI(developers.googleblog.com)
475 points by meetpateltech | 193 comments
Google Developers Blog post announcing Gemma 3 270M, a compact open model designed for hyper-efficient, task-specific AI.
Introducing Gemma 3n(developers.googleblog.com)
361 points by bundie | 159 comments
Google for Developers blog post introducing Gemma 3n, a developer guide to Google's new on-device open model.
Gemma 3n preview: Mobile-first AI(developers.googleblog.com)
418 points by meetpateltech | 145 comments
Google for Developers blog post announcing the preview of Gemma 3n, an efficient, mobile-first open AI model designed for on-device use.
Apple squandered the Holy Grail(xeiaso.net)
356 points by caust1c | 479 comments
Blog post by Xe Iaso arguing that Apple Intelligence failed despite being built on nearly perfect underlying technology.
Quantized Llama models with increased speed and a reduced memory footprint(ai.meta.com)
471 points by egnehots | 112 comments
Meta AI blog post announcing quantized versions of its Llama models that run faster and use less memory.
Apple's On-Device and Server Foundation Models(machinelearning.apple.com)
890 points by 2bit | 479 comments
Apple Machine Learning Research post introducing the on-device and server foundation language models behind Apple Intelligence.
Introducing Copilot+ PCs(blogs.microsoft.com)
329 points by skilled | 460 comments
Official Microsoft Blog post from May 20, 2024 by Yusuf Mehdi announcing Copilot+ PCs, a new category of AI-focused Windows PCs.