Prefill-as-a-Service:KVCache of Next-Generation Models Could Go Cross-Datacenter (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Prefill-as-a-Service:KVCache of Next-Generation Models Could Go Cross-Datacenter

First screen, captured 6 months ago.

Looks similar

Screenshot of arxiv.org: KV Cache Compression 900000x Beyond TurboQuant and Per-Vector Shannon Limit

KV Cache Compression 900000x Beyond TurboQuant and Per-Vector Shannon Limit (arxiv.org)

40 points by EGreg 6 months ago | 11 comments

Screenshot of arxiv.org: A GS-Cache Inference Framework for Large-Scale Gaussian Splatting Models

A GS-Cache Inference Framework for Large-Scale Gaussian Splatting Models (arxiv.org)

13 points by PaulHoule 1 year ago | 1 comments

Screenshot of arxiv.org: Parameter-free KV cache compression for memory-efficient long-context LLMs

Parameter-free KV cache compression for memory-efficient long-context LLMs (arxiv.org)

60 points by PaulHoule 1 year ago | 13 comments

Screenshot of arxiv.org: Scalable MatMul-Free Language Modeling

Scalable MatMul-Free Language Modeling (arxiv.org)

177 points by lykahb 2 years ago | 27 comments

Screenshot of arxiv.org: Flash-KMeans: Fast and Memory-Efficient Exact K-Means

Flash-KMeans: Fast and Memory-Efficient Exact K-Means (arxiv.org)

176 points by matt_d 7 months ago | 14 comments

Screenshot of arxiv.org: CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs

CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs (arxiv.org)

96 points by matt_d 5 months ago | 12 comments