LLaMA now goes faster on CPUs(justine.lol)

1286 points by lawrencechen 2 years ago | 413 comments

Justine Tunney's blog post describing 84 new matrix multiplication kernels that make llamafile prompt evaluation 30-500% faster on CPUs than llama.cpp.

Weird Lexical Syntax(justine.lol)

407 points by jart 2 years ago | 214 comments

Justine Tunney's blog post surveying surprising lexical syntax quirks across 42 programming languages learned while building a syntax highlighter for llamafile.

Update on Llama adoption(ai.meta.com)

136 points by meetpateltech 2 years ago | 155 comments

Bash one-liners for LLMs(justine.lol)

265 points by severine 2 years ago | 54 comments

Zig's new bitCast semantics and LLVM back end improvements(ziglang.org)

266 points by kouosi 4 months ago | 135 comments

Llama 3.2: Revolutionizing edge AI and vision with open, customizable models(ai.meta.com)

861 points by nmwnmw 2 years ago | 298 comments

Meta AI blog post announcing Llama 3.2, including vision-capable models and lightweight models for edge and mobile devices.