The Illustrated GPT-2: Visualizing Transformer Language Models (2019) (jalammar.github.io)

Screenshot of jalammar.github.io: The Illustrated GPT-2: Visualizing Transformer Language Models (2019)

First screen, captured 2 years ago.

Looks similar

Screenshot of jalammar.github.io: The Illustrated Transformer (2018)

The Illustrated Transformer (2018)(jalammar.github.io)

138 points by debdut 2 years ago | 7 comments

Screenshot of jalammar.github.io: The Illustrated Transformer

The Illustrated Transformer (jalammar.github.io)

468 points by auraham 10 months ago | 85 comments

Jay Alammar's illustrated blog post explaining the Transformer neural network architecture and its self-attention mechanism with visual diagrams.

transformer attention deep-learning nlp

Screenshot of yitay.net: What happened to BERT and T5?

What happened to BERT and T5?(yitay.net)

218 points by fzliu 2 years ago | 63 comments

Screenshot of ikkaro.net: TinyML: Ultra-low power machine learning

TinyML: Ultra-low power machine learning (ikkaro.net)

349 points by Gedxx 2 years ago | 84 comments

An Ikkaro blog article explaining TinyML, covering model compression techniques like pruning, quantization and distillation, tools, and uses on low-power devices.

tinyml embedded-ml microcontrollers quantization

Screenshot of kipp.ly: Transformer Inference Arithmetic (2022)

Transformer Inference Arithmetic (2022)(kipp.ly)

36 points by lawrencechen 3 years ago | 4 comments

Screenshot of manifestai.com: Linear transformers are faster after all

Linear transformers are faster after all (manifestai.com)

94 points by JoelEinbinder 2 years ago | 16 comments