δ-mem: Efficient Online Memory for Large Language Models(arxiv.org)227 points by 44za12 5 months ago | 58 comments
Parameter-free KV cache compression for memory-efficient long-context LLMs(arxiv.org)60 points by PaulHoule 1 year ago | 13 comments
All-in-Memory Stochastic Computing Using ReRAM(arxiv.org)19 points by rbanffy 1 year ago | 0 comments
QLoRA: Efficient Finetuning of Quantized LLMs(arxiv.org)270 points by Garcia98 3 years ago | 90 comments
A Photonic SRAM with Embedded XOR Logic for Ultra-Fast In-Memory Computing(arxiv.org)49 points by PaulHoule 1 year ago | 13 comments
CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs(arxiv.org)96 points by matt_d 5 months ago | 12 comments