An Intuitive Explanation of Sparse Autoencoders for LLM Interpretability(adamkarvonen.github.io)

77 points by sebg 1 year ago | 1 comments

Tested Kimi K3 for Coding(dotnetperls.com)

31 points by speckx 3 months ago | 6 comments

LLM Architecture Gallery(sebastianraschka.com)

459 points by tzury 7 months ago | 34 comments

Sebastian Raschka's gallery of architecture diagrams and fact sheets for open-weight LLMs such as Llama, OLMo, Qwen, and DeepSeek.

Zig's new bitCast semantics and LLVM back end improvements(ziglang.org)

266 points by kouosi 4 months ago | 135 comments

Kimi K3, and what we can still learn from the pelican benchmark(simonwillison.net)

387 points by droidjj 3 months ago | 209 comments

Simon Willison blog post on Moonshot AI's 2.8-trillion-parameter Kimi K3 model, its benchmarks and pricing, and his pelican-on-a-bicycle test results.

Summing ASCII encoded integers on Haswell at almost the speed of memcpy(blog.mattstuchlik.com)

114 points by iliekcomputers 2 years ago | 34 comments

LLM Architecture Gallery(sebastianraschka.com)

459 points by tzury 7 months ago | 34 comments

Sebastian Raschka's gallery of architecture diagrams and fact sheets for open-weight LLMs such as Llama, OLMo, Qwen, and DeepSeek.

Notes on OpenAI's new o1 chain-of-thought models(simonwillison.net)

641 points by loganfrederick 2 years ago | 566 comments

Simon Willison's blog post with notes on OpenAI's o1-preview and o1-mini models, covering chain-of-thought training, API details, hidden reasoning tokens and examples.

Qwen3-Next(qwen.ai)

519 points by tosh 1 year ago | 201 comments

Qwen team blog post announcing Qwen3-Next, a model architecture aimed at improving LLM training and inference efficiency.

Train Your Own LLM from Scratch(github.com)

376 points by kristianpaul 5 months ago | 43 comments

GitHub repository by angelos-p providing code and docs for training your own large language model from scratch.

Open-weight AI is having its Kubernetes moment(tobi.knaup.me)

369 points by tknaup 3 months ago | 287 comments

Blog post by Tobi Knaup arguing that open-weight AI models are at a moment comparable to Kubernetes' rise, and urging the community not to squander it.

Grok(github.com)

1034 points by pierre 2 years ago | 375 comments

GitHub repository from xAI containing the open release of the Grok language model code and checkpoint loading scripts under Apache-2.0.