Llama.ttf: A font which is also an LLM(fuglede.github.io)

554 points by fuglede_ 2 years ago | 142 comments

Project page for llama.ttf, a font file that embeds a Llama language model and inference engine via HarfBuzz's Wasm shaper.

Five Years of LLM Progress(finbarr.ca)

32 points by goranmoomin 3 years ago | 0 comments

Lambda Calculus in 383 Bytes (2022)(justine.lol)

298 points by MrBuddyCasino 1 year ago | 48 comments

Page Table Memory Consumption(frn.sh)

57 points by shellpipe 25 days ago | 10 comments

Blog post by Fernando Simões examining page table memory consumption, prompted by Linus Torvalds' 2003 argument for multi-level over hashed page tables.

Programming the Gigatron(iwriteiam.nl)

14 points by shakna 2 months ago | 1 comments

LLaMA now goes faster on CPUs(justine.lol)

1286 points by lawrencechen 2 years ago | 413 comments

Justine Tunney's blog post describing 84 new matrix multiplication kernels that make llamafile prompt evaluation 30-500% faster on CPUs than llama.cpp.

My finetuned models beat OpenAI's GPT-4(mlops.systems)

376 points by majc2 2 years ago | 86 comments

Blog post evaluating finetuned Mistral, Llama3 and Solar LLMs against OpenAI's GPT-4 on accuracy for structured data extraction from press releases.

Run Llama 2 uncensored locally(ollama.ai)

618 points by jmorgan 3 years ago | 187 comments

Ollama blog post from August 1, 2023 explaining how to run an uncensored Llama 2 model locally using Ollama.

Llama.cpp guide – Running LLMs locally on any hardware, from scratch(steelph0enix.github.io)

318 points by zarekr 1 year ago | 60 comments

A long blog guide on building and running llama.cpp to run large language models locally on various hardware, from scratch.

Llamafile lets you distribute and run LLMs with a single file(github.com)

972 points by tfinch 2 years ago | 253 comments

GitHub repository for Mozilla-Ocho's llamafile, a tool to distribute and run large language models as a single executable file.

Llama2.c: Inference llama 2 in one file of pure C(github.com)

659 points by anjneymidha 3 years ago | 158 comments

GitHub repository by Andrej Karpathy for llama2.c, a minimal implementation for running Llama 2 model inference in a single file of pure C.

Phind-405B and faster, high quality AI answers for everyone(phind.com)

331 points by rushingcreek 2 years ago | 135 comments

Phind blog post announcing its Phind-405B model and faster, higher-quality AI search answers; the capture shows a Cloudflare verification page.