Weird Lexical Syntax(justine.lol)
407 points by jart | 214 comments
Justine Tunney's blog post surveying surprising lexical syntax quirks across 42 programming languages learned while building a syntax highlighter for llamafile.
#llamafile on Hacker News
5 stories tagged llamafile, newest first.
New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy(github.com)
368 points by weinzierl | 72 comments
GitHub pull request to llama.cpp by jart that upstreams llamafile's vectorized expf() functions to compute SiLU and softmax faster and more accurately on CPU.
LLaMA now goes faster on CPUs(justine.lol)
1286 points by lawrencechen | 413 comments
Justine Tunney's blog post describing 84 new matrix multiplication kernels that make llamafile prompt evaluation 30-500% faster on CPUs than llama.cpp.
Emacs-copilot: Large language model code completion for Emacs(github.com)
326 points by yla92 | 136 comments
GitHub repository for emacs-copilot by jart, an Emacs Lisp package providing large language model code completion inside Emacs.
Llamafile lets you distribute and run LLMs with a single file(github.com)
972 points by tfinch | 253 comments
GitHub repository for Mozilla-Ocho's llamafile, a tool to distribute and run large language models as a single executable file.