26× Faster Inference with Layer-Condensed KV Cache for Large Language Models(arxiv.org)112 points by georgehill 2 years ago | 16 comments
Prefill-as-a-Service:KVCache of Next-Generation Models Could Go Cross-Datacenter(arxiv.org)42 points by matt_d 6 months ago | 1 comments
WildGaussians: 3D Gaussian Splatting in the Wild(arxiv.org)100 points by alphabetting 2 years ago | 18 comments
Parameter-free KV cache compression for memory-efficient long-context LLMs(arxiv.org)60 points by PaulHoule 1 year ago | 13 comments
Cache-to-Cache: Direct Semantic Communication Between LLMs (2025)(arxiv.org)98 points by rochansinha 1 month ago | 16 comments
DeepSeek: Inference-Time Scaling for Generalist Reward Modeling(arxiv.org)125 points by tim_sw 1 year ago | 24 comments