llamafile: Distribute and Run LLMs with a Single File(github.com)

35 points by stefankuehnel 10 months ago | 4 comments

Llama.vim – Local LLM-assisted text completion(github.com)

496 points by kgwgk 1 year ago | 97 comments

GitHub repository for llama.vim, a Vim plugin that provides local LLM-assisted code and text completion using llama.cpp.

Launch HN: LlamaFarm (YC W22) – Open-source framework for distributed AI(github.com)

99 points by mhamann 1 year ago | 51 comments

Ocicl – An ASDF system distribution and management tool for Common Lisp(github.com)

35 points by gjvc 3 years ago | 12 comments

Show HN: Tune LLaMa3.1 on Google Cloud TPUs(github.com)

157 points by felarof 2 years ago | 46 comments

Jamesob's guide to running SOTA LLMs locally(github.com)

390 points by livestyle 3 months ago | 175 comments

GitHub repository by jamesob collecting notes, runners, and tools for running state-of-the-art LLMs locally.

Experimenting with Local LLMs on macOS(blog.6nok.org)

367 points by frontsideair 1 year ago | 241 comments

A personal blog post by a self-described LLM skeptic explaining how to download and run large language models locally on a Mac.

Llama2.c: Inference llama 2 in one file of pure C(github.com)

659 points by anjneymidha 3 years ago | 158 comments

GitHub repository by Andrej Karpathy for llama2.c, a minimal implementation for running Llama 2 model inference in a single file of pure C.

Talk-Llama(github.com)

428 points by plurby 3 years ago | 126 comments

GitHub directory for talk-llama, a whisper.cpp example that lets you talk to a LLaMA model locally using speech recognition and text-to-speech.

LLM4Decompile: Decompiling Binary Code with LLM(github.com)

373 points by Davidbrcz 2 years ago | 120 comments

GitHub repository for LLM4Decompile, a project using large language models to decompile binary code, with evaluation scripts and samples.

Run Llama 13B with a 6GB graphics card(gist.github.com)

564 points by rain1 3 years ago | 233 comments

A GitHub Gist with instructions for running Meta's Llama 13B model on a 6GB GPU using llama.cpp's CUDA/cuBLAS layer offloading.

How to setup a local coding agent on macOS(ikyle.me)

464 points by kkm 4 months ago | 114 comments

A blog tutorial on running Gemma 4 and Qwen3.6 locally on macOS with llama.cpp, MTP speculative decoding, and multimodal support as a coding agent.