Transformers Are Inherently Succinct (2025)(arxiv.org)45 points by bearseascape 5 months ago | 6 comments
Exploring the Limits of Transfer Learning with a Unified Transformer (2019)(arxiv.org)11 points by yeesian 2 years ago | 0 comments
Transformers Can Do Arithmetic with the Right Embeddings(arxiv.org)186 points by byt3h3ad 2 years ago | 191 comments
Expanding Transformer size without losing function or starting from scratch(arxiv.org)46 points by og_kalu 3 years ago | 24 comments
LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)(arxiv.org)125 points by tosh 3 years ago | 15 comments