SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs(arxiv.org)25 points by PaulHoule 1 year ago | 5 comments
Paper2Code: Automating Code Generation from Scientific Papers(arxiv.org)122 points by Jerry2 1 year ago | 23 comments
Parameter-free KV cache compression for memory-efficient long-context LLMs(arxiv.org)60 points by PaulHoule 1 year ago | 13 comments
Rethinking Losses for Diffusion Bridge Samplers(arxiv.org)6 points by badmonster 1 year ago | 1 comments
Old Is Gold: Optimizing Single-Threaded Applications with Exgen-Malloc(arxiv.org)7 points by todsacerdoti 1 year ago | 3 comments
KV Cache Compression 900000x Beyond TurboQuant and Per-Vector Shannon Limit(arxiv.org)40 points by EGreg 6 months ago | 11 comments