Attention with Linear Biases (ALiBi) (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Attention with Linear Biases (ALiBi)

First screen, captured 3 years ago.

Looks similar

Screenshot of arxiv.org: Log-Linear Attention

Log-Linear Attention (arxiv.org)

19 points by sva_ 1 year ago | 3 comments

Screenshot of arxiv.org: Unlimiformer: Long-Range Transformers with Unlimited Length Input

Unlimiformer: Long-Range Transformers with Unlimited Length Input (arxiv.org)

315 points by shishy 3 years ago | 97 comments

Screenshot of arxiv.org: Landmark infinite context transformer paper just dropped

Landmark infinite context transformer paper just dropped (arxiv.org)

17 points by jasonwcfan 3 years ago | 5 comments

Screenshot of arxiv.org: HyperAttention: Long-Context Attention in Near-Linear Time

HyperAttention: Long-Context Attention in Near-Linear Time (arxiv.org)

61 points by kelseyfrog 3 years ago | 10 comments

Screenshot of arxiv.org: Multi-Token Attention

Multi-Token Attention (arxiv.org)

131 points by fzliu 1 year ago | 35 comments

Screenshot of arxiv.org: LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)

LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale (2022)(arxiv.org)

125 points by tosh 3 years ago | 15 comments