Lithp.py (~2008)(fogus.me)
28 points by wglb | 5 comments
28 points by wglb | 5 comments
219 points by tosh | 72 comments
98 points by paulgb | 50 comments
496 points by kgwgk | 97 comments
GitHub repository for llama.vim, a Vim plugin that provides local LLM-assisted code and text completion using llama.cpp.
972 points by tfinch | 253 comments
GitHub repository for Mozilla-Ocho's llamafile, a tool to distribute and run large language models as a single executable file.
318 points by zarekr | 60 comments
A long blog guide on building and running llama.cpp to run large language models locally on various hardware, from scratch.
404 points by orixilus | 48 comments
GitHub repository llama3.np, a pure NumPy implementation of the Llama 3 language model for inference.
648 points by birriel | 210 comments
Blog post by Finbarr Timbers explaining the math of why llama.cpp can run LLaMA models locally on consumer hardware, focusing on memory bandwidth and compute limits.
379 points by davepeck | 95 comments
A GitHub pull request to llama.cpp adding an API for grammar-based sampling that constrains LLM output with a BNF-like context-free grammar.