Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet(transformer-circuits.pub)136 points by 1wheel 2 years ago | 26 comments
Towards Monosemanticity: Decomposing Language Models with Dictionary Learning(transformer-circuits.pub)56 points by goodmachine 3 years ago | 3 comments
Circuit Tracing: Revealing Computational Graphs in Language Models (Anthropic)(transformer-circuits.pub)161 points by ydnyshhh 1 year ago | 27 comments
When models manipulate manifolds: The geometry of a counting task(transformer-circuits.pub)84 points by vinhnx 1 year ago | 10 comments
A Mathematical Framework for Transformer Circuits (2021)(transformer-circuits.pub)95 points by Bluestein 1 month ago | 17 comments
Emergent Introspective Awareness in Large Language Models(transformer-circuits.pub)7 points by og_kalu 1 year ago | 1 comments