When models manipulate manifolds: The geometry of a counting task(transformer-circuits.pub)84 points by vinhnx 1 year ago | 10 comments
Circuit Tracing: Revealing Computational Graphs in Language Models (Anthropic)(transformer-circuits.pub)161 points by ydnyshhh 1 year ago | 27 comments
Towards Monosemanticity: Decomposing Language Models with Dictionary Learning(transformer-circuits.pub)56 points by goodmachine 3 years ago | 3 comments
Transformer Transformer: A Unified Model for Motion-Conditioned Robot Co-Design(transformer-transformer.github.io)69 points by ilreb 2 months ago | 8 comments
Modern Optimizers – An Alchemist's Notes on Deep Learning(notes.kvfrans.com)27 points by maxall4 11 months ago | 1 comments
A Mathematical Framework for Transformer Circuits (2021)(transformer-circuits.pub)95 points by Bluestein 1 month ago | 17 comments