Transformers Without Normalization(jiachenzhu.github.io)

247 points by hellollm 1 year ago | 30 comments

Backprop Alternative: Augmented Lagrangian Predictive Coding(pub.sakana.ai)

102 points by guld 1 month ago | 34 comments

Show HN: Microgpt is a GPT you can visualize in the browser(microgpt.boratto.ca)

261 points by b44 8 months ago | 23 comments

MorphoHDL: A minimalistic language for growing circuits(paradigms-of-intelligence.github.io)

87 points by jacktang 3 months ago | 8 comments

GPUHammer: Rowhammer attacks on GPU memories are practical(gpuhammer.com)

260 points by jonbaer 1 year ago | 89 comments

Transformers Explained Visually(poloclub.github.io)

576 points by aray07 1 month ago | 85 comments

Transformer Explainer is an interactive in-browser visualization that runs GPT-2 and shows how embeddings, multi-head self-attention, and MLP layers process text.

What are transformer models and how do they work?(txt.cohere.ai)

380 points by tomcam 3 years ago | 91 comments

Cohere blog post explaining what transformer models are and how they work in natural language processing.

RustGPT: A pure-Rust transformer LLM built from scratch(github.com)

357 points by amazonhut 1 year ago | 170 comments

GitHub repository for RustGPT, a transformer-based large language model written entirely in Rust from scratch.

Deep learning gets the glory, deep fact checking gets ignored(rachel.fast.ai)

549 points by chmaynard 1 year ago | 134 comments

Rachel Thomas blog post on how a high-profile Nature paper using a Transformer to predict enzyme functions contained many errors that received far less attention than the original result.

GPT-6 Astra, looped transformers, and hidden reasoning(magazine.sebastianraschka.com)

491 points by ModelForge 1 month ago | 158 comments

Sebastian Raschka's Ahead of AI newsletter post examining OpenAI's GPT-6 Astra, looped transformers with recurrent depth, and hidden chain-of-thought reasoning research.

MeshGPT: Generating triangle meshes with decoder-only transformers(nihalsid.github.io)

684 points by jackcook 2 years ago | 148 comments

Project page for MeshGPT, a research paper from TU Munich, Politecnico di Torino and Audi that generates triangle meshes using decoder-only transformers.

GPT-5.2 derives a new result in theoretical physics(openai.com)

545 points by davidbarker 8 months ago | 369 comments

OpenAI post announcing that GPT-5.2 derived a new result in theoretical physics; the captured page shows only a loading logo.