Llamafile: Bringing LLMs to the people, and to your own computer (future.mozilla.org)

Screenshot of future.mozilla.org: Llamafile: Bringing LLMs to the people, and to your own computer

First screen, captured 2 years ago.

Looks similar

Screenshot of justine.lol: Bash one-liners for LLMs

Bash one-liners for LLMs (justine.lol)

265 points by severine 2 years ago | 54 comments

Screenshot of justine.lol: LLaMA now goes faster on CPUs

LLaMA now goes faster on CPUs (justine.lol)

1286 points by lawrencechen 2 years ago | 413 comments

Justine Tunney's blog post describing 84 new matrix multiplication kernels that make llamafile prompt evaluation 30-500% faster on CPUs than llama.cpp.

llamafile llama-cpp matrix-multiplication cpu-inference

Screenshot of simonwillison.net: Llamafile is the new best way to run a LLM on your own computer

Llamafile is the new best way to run a LLM on your own computer (simonwillison.net)

108 points by djha-skin 2 years ago | 22 comments

Screenshot of alessiofanelli.com: In the LLM space, "open source" is being used to mean "downloadable weights"

In the LLM space, "open source" is being used to mean "downloadable weights"(alessiofanelli.com)

353 points by FanaHOVA 3 years ago | 210 comments

Blog post by Alessio Fanelli arguing that LLaMA2 isn't truly open source under the OSS definition, and why that distinction may not matter much.

llama-2 open-source-licensing llm meta

Screenshot of interconnects.ai: Llama 2: an open-source LLM

Llama 2: an open-source LLM (interconnects.ai)

35 points by tim_sw 3 years ago | 4 comments

Screenshot of cloudflare.com: Cloudflare and Meta Collaborate to Make Llama 2 Available Globally

Cloudflare and Meta Collaborate to Make Llama 2 Available Globally (cloudflare.com)

73 points by kristianpaul 3 years ago | 14 comments

Looks similar

Bash one-liners for LLMs(justine.lol)

LLaMA now goes faster on CPUs(justine.lol)

Llamafile is the new best way to run a LLM on your own computer(simonwillison.net)