Unlimiformer: Long-Range Transformers with Unlimited Length Input(arxiv.org)315 points by shishy 3 years ago | 97 comments
CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs(arxiv.org)96 points by matt_d 5 months ago | 12 comments
SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs(arxiv.org)25 points by PaulHoule 1 year ago | 5 comments