Kimi K3 Architecture Overview and Notes(sebastianraschka.com)
472 points by ModelForge | 101 comments
Sebastian Raschka's blog post with an architecture figure and notes on the Kimi K3 open-weight model, a 2.8T scaled-up version of Kimi Linear.
#sebastian-raschka on Hacker News
4 stories tagged sebastian-raschka, newest first.
LLM Architecture Gallery(sebastianraschka.com)
459 points by tzury | 34 comments
Sebastian Raschka's gallery of architecture diagrams and fact sheets for open-weight LLMs such as Llama, OLMo, Qwen, and DeepSeek.
Writing an LLM from scratch, part 8 – trainable self-attention(gilesthomas.com)
350 points by gpjt | 26 comments
Blog post, part 8 of a series working through Raschka's 'Build a Large Language Model (from Scratch)', explaining self-attention with trainable weights.
Building LLMs from the Ground Up: A 3-Hour Coding Workshop(magazine.sebastianraschka.com)
910 points by mdp2021 | 110 comments
Sebastian Raschka's Ahead of AI newsletter post presenting a 3-hour video coding workshop on implementing, training, and using LLMs from scratch.