7 stories tagged cpu-inference, newest first.
39 points by edwardchalk | 31 comments
Blog post deep-diving into Minotaur, an AI architecture claimed to perform deduction, diagnosis and causal reasoning without a language model or GPU, with a history of prior AI approaches.
207 points by khalidkhair | 77 comments
GitHub repository for Janas, a pure C inference engine that runs LLMs larger than RAM by streaming MoE experts from SSD, on CPU or GPU.
6 points by nico | 1 comments
GitHub repository for Jeffy, a Python library of pretrained text classifiers that run and retrain locally on CPU without a GPU.
493 points by speckx | 92 comments
Blog post by Ariya Hidayat on running Kokoro, a high-quality text-to-speech model, locally on a CPU, with an embedded demo video.
659 points by cafkafk | 266 comments
Blog post about running Google's Gemma 4 language model locally on a 2016-era Intel Xeon server.
331 points by sammyyyyyyy | 116 comments
GitHub repository for Sopro, a lightweight 169M-parameter text-to-speech model with zero-shot voice cloning that runs on CPU, under Apache-2.0.
1286 points by lawrencechen | 413 comments
Justine Tunney's blog post describing 84 new matrix multiplication kernels that make llamafile prompt evaluation 30-500% faster on CPUs than llama.cpp.