llamafile: Distribute and Run LLMs with a Single File(github.com)

35 points by stefankuehnel 10 months ago | 4 comments

Llama2-shepherd a CLI tool to install multiple implementations of the llama2(github.com)

49 points by mikepapadim 2 years ago | 8 comments

I have written gemma3 inference in pure C(github.com)

46 points by robitec97 9 months ago | 17 comments

Autology: A Lisp with access to its own interpreter(github.com)

126 points by simonpure 1 year ago | 48 comments

Llama 3.1 Omni Model(github.com)

284 points by taikon 2 years ago | 36 comments

ePub-utils: A Python library and CLI tool for inspecting ePub from the terminal(github.com)

96 points by ernstgnzlz 1 year ago | 9 comments

Llama2.c: Inference llama 2 in one file of pure C(github.com)

659 points by anjneymidha 3 years ago | 158 comments

GitHub repository by Andrej Karpathy for llama2.c, a minimal implementation for running Llama 2 model inference in a single file of pure C.

Show HN: Local pretrained classifiers, GPU not needed(github.com)

6 points by nico 22 days ago | 1 comments

GitHub repository for Jeffy, a Python library of pretrained text classifiers that run and retrain locally on CPU without a GPU.

Llamafile lets you distribute and run LLMs with a single file(github.com)

972 points by tfinch 2 years ago | 253 comments

GitHub repository for Mozilla-Ocho's llamafile, a tool to distribute and run large language models as a single executable file.

Llama.cpp 30B runs with only 6GB of RAM now(github.com)

1182 points by msoad 3 years ago | 356 comments

GitHub pull request #613 in llama.cpp by jart, merged, which uses mmap to make loading model weights 10-100x faster and reduce RAM usage.

Show HN: Sumi.css – CSS Framework(github.com)

58 points by bepero 5 days ago | 13 comments

GitHub repository for Sumi.css, a minimalist classless-first CSS framework (6.7 KB gzipped) with dark mode, theming via custom properties, and no build step.

Llama3 implemented from scratch(github.com)

987 points by Hadi7546 2 years ago | 246 comments

GitHub repository with a Jupyter notebook implementing Meta's Llama 3 model from scratch, one matrix multiplication at a time.