Speculative KV coding: losslessly compressing KV cache by up to ~4×(fergusfinn.com)

137 points by kkm 4 months ago | 28 comments

LLMs can be exhausting(tomjohnell.com)

256 points by tjohnell 7 months ago | 171 comments

LLMs as Compilers(resync-games.com)

28 points by kadhirvelm 1 year ago | 38 comments

Show HN: My LLM CLI tool can run tools now, from Python code or plugins(simonwillison.net)

494 points by simonw 1 year ago | 157 comments

Simon Willison's blog post announcing LLM 0.26, which adds tool support to his LLM CLI and Python library via Python functions and tool plugins.

Zig's new bitCast semantics and LLVM back end improvements(ziglang.org)

266 points by kouosi 4 months ago | 135 comments

Scheduling Model in LLVM(myhsu.xyz)

63 points by mshockwave 2 years ago | 2 comments