The FFT Strikes Back: An Efficient Alternative to Self-Attention(arxiv.org)
438 points by iNic | 161 comments
arXiv paper introducing FFTNet, an FFT-based adaptive spectral filtering framework offering O(n log n) token mixing as an alternative to self-attention.