Transcribe.cpp(workshop.cjpais.com)
696 points by sebjones | 144 comments
Project page announcing transcribe.cpp, a ggml-based speech transcription library supporting recent models, from the author of the Handy speech-to-text app.
#ggml on Hacker News
8 stories tagged ggml, newest first.
Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI(github.com)
807 points by lairv | 211 comments
GitHub Discussions announcement by Georgi Gerganov that ggml.ai, the founding team of llama.cpp, is joining Hugging Face to support local AI.
Vision Now Available in Llama.cpp(github.com)
475 points by redman25 | 104 comments
Documentation page in the llama.cpp GitHub repository describing multimodal (vision) input support via libmtmd and the tools that use it.
Promising results from DeepSeek R1 for code(simonwillison.net)
926 points by k__ | 689 comments
Simon Willison blog post on a llama.cpp PR doubling WASM speed via SIMD, mostly written by DeepSeek R1, plus his own results using R1 for code.
Llama.vim – Local LLM-assisted text completion(github.com)
496 points by kgwgk | 97 comments
GitHub repository for llama.vim, a Vim plugin that provides local LLM-assisted code and text completion using llama.cpp.
New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy(github.com)
368 points by weinzierl | 72 comments
GitHub pull request to llama.cpp by jart that upstreams llamafile's vectorized expf() functions to compute SiLU and softmax faster and more accurately on CPU.
Llama.cpp: Full CUDA GPU Acceleration(github.com)
640 points by gzer0 | 265 comments
A draft GitHub pull request to llama.cpp adding full CUDA GPU acceleration for all ggml tensors, including storing the KV cache in VRAM.
GGML – AI at the Edge(ggml.ai)
817 points by georgehill | 206 comments
Homepage for ggml, a C tensor library for running machine learning models on commodity hardware, used by llama.cpp and whisper.cpp.