Run LLMs at home, BitTorrent‑style(petals.dev)
404 points by udev4096 | 96 comments
Homepage of Petals, a system for running large language models like Llama 2 and BLOOM collaboratively across volunteer machines, BitTorrent-style.
#llama-2 on Hacker News
8 stories tagged llama-2, newest first.
Fine-tune your own Llama 2 to replace GPT-3.5/4
825 points by kcorbitt | 158 comments
Show HN post sharing notebooks and lessons on fine-tuning Llama 2 7B to match GPT-4 on a recipe classification task at far lower cost.
Run Llama 2 uncensored locally(ollama.ai)
618 points by jmorgan | 187 comments
Ollama blog post from August 1, 2023 explaining how to run an uncensored Llama 2 model locally using Ollama.
Show HN: Khoj – Chat offline with your second brain using Llama 2(github.com)
501 points by 110 | 109 comments
GitHub repository for Khoj, an open-source AI personal assistant that searches and chats with your notes and documents, offline via Llama 2 or online via GPT.
Guide to running Llama 2 locally(replicate.com)
573 points by bfirsh | 153 comments
Replicate blog post explaining how to run Meta's Llama 2 model locally on M1/M2 Macs, Windows, Linux, and phones without an internet connection.
Llama2.c: Inference llama 2 in one file of pure C(github.com)
659 points by anjneymidha | 158 comments
GitHub repository by Andrej Karpathy for llama2.c, a minimal implementation for running Llama 2 model inference in a single file of pure C.
In the LLM space, "open source" is being used to mean "downloadable weights"(alessiofanelli.com)
353 points by FanaHOVA | 210 comments
Blog post by Alessio Fanelli arguing that LLaMA2 isn't truly open source under the OSS definition, and why that distinction may not matter much.
Llama 2(ai.meta.com)
2177 points by friggeri | 781 comments
Meta AI's launch page introducing Llama 2, its open large language model available free for research and commercial use, with a model download link.