Kimi K3 Architecture Overview and Notes(sebastianraschka.com)
472 points by ModelForge | 101 comments
Sebastian Raschka's blog post with an architecture figure and notes on the Kimi K3 open-weight model, a 2.8T scaled-up version of Kimi Linear.
5 stories tagged llm-architecture, newest first.
472 points by ModelForge | 101 comments
Sebastian Raschka's blog post with an architecture figure and notes on the Kimi K3 open-weight model, a 2.8T scaled-up version of Kimi Linear.
459 points by tzury | 34 comments
Sebastian Raschka's gallery of architecture diagrams and fact sheets for open-weight LLMs such as Llama, OLMo, Qwen, and DeepSeek.
450 points by ModelForge | 95 comments
Sebastian Raschka's Ahead of AI article analyzing the architecture of OpenAI's open-weight gpt-oss models, tracing changes since GPT-2 and comparing them to Qwen3.
357 points by mdp2021 | 23 comments
Sebastian Raschka's Ahead of AI article comparing the architectures of modern LLMs, from DeepSeek-V3 to Kimi K2.
569 points by bx376 | 488 comments
A Thread Reader unrolled 37-tweet Twitter thread by Yam Peleg purporting to reveal leaked architecture and training details of OpenAI's GPT-4.