Do transformers need three projections? Systematic study of QKV variants(arxiv.org)202 points by Anon84 4 months ago | 39 comments
Can a transformer represent a Kalman filter?(arxiv.org)160 points by bluish29 2 years ago | 55 comments
Inverted Transformers Are Effective for Time Series Forecasting(arxiv.org)177 points by beefman 3 years ago | 27 comments
LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)(arxiv.org)125 points by tosh 3 years ago | 15 comments