Looks similar
Llama.vim – Local LLM-assisted text completion(github.com)
496 points by kgwgk | 97 comments
GitHub repository for llama.vim, a Vim plugin that provides local LLM-assisted code and text completion using llama.cpp.
Related stories
Llama3 implemented from scratch(github.com)
987 points by Hadi7546 | 246 comments
GitHub repository with a Jupyter notebook implementing Meta's Llama 3 model from scratch, one matrix multiplication at a time.
Llama2.c: Inference llama 2 in one file of pure C(github.com)
659 points by anjneymidha | 158 comments
GitHub repository by Andrej Karpathy for llama2.c, a minimal implementation for running Llama 2 model inference in a single file of pure C.
Llamafile lets you distribute and run LLMs with a single file(github.com)
972 points by tfinch | 253 comments
GitHub repository for Mozilla-Ocho's llamafile, a tool to distribute and run large language models as a single executable file.
Run Llama 13B with a 6GB graphics card(gist.github.com)
564 points by rain1 | 233 comments
A GitHub Gist with instructions for running Meta's Llama 13B model on a 6GB GPU using llama.cpp's CUDA/cuBLAS layer offloading.
Talk-Llama(github.com)
428 points by plurby | 126 comments
GitHub directory for talk-llama, a whisper.cpp example that lets you talk to a LLaMA model locally using speech recognition and text-to-speech.
Llama.cpp guide – Running LLMs locally on any hardware, from scratch(steelph0enix.github.io)
318 points by zarekr | 60 comments
A long blog guide on building and running llama.cpp to run large language models locally on various hardware, from scratch.












