Log-Linear Attention (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Log-Linear Attention

First screen, captured 1 year ago.

Looks similar

Screenshot of arxiv.org: HyperAttention: Long-Context Attention in Near-Linear Time

HyperAttention: Long-Context Attention in Near-Linear Time (arxiv.org)

61 points by kelseyfrog 3 years ago | 10 comments

Screenshot of arxiv.org: Multi-Token Attention

Multi-Token Attention (arxiv.org)

131 points by fzliu 1 year ago | 35 comments

Screenshot of arxiv.org: Infinite Retrieval: Attention enhanced LLMs in long-context processing

Infinite Retrieval: Attention enhanced LLMs in long-context processing (arxiv.org)

26 points by TaurenHunter 1 year ago | 3 comments

Screenshot of arxiv.org: Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation

Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation (arxiv.org)

158 points by fheinsen 8 months ago | 87 comments

Screenshot of arxiv.org: LoMA: Lossless Compressed Memory Attention

LoMA: Lossless Compressed Memory Attention (arxiv.org)

90 points by PaulHoule 2 years ago | 8 comments

Screenshot of aclanthology.org: Native Sparse Attention

Native Sparse Attention (aclanthology.org)

127 points by CalmStorm 1 year ago | 25 comments