Lossless Compression of Vector IDs for Approximate Nearest Neighbor Search (arxiv.org)

Screenshot of arxiv.org: Lossless Compression of Vector IDs for Approximate Nearest Neighbor Search

First screen, captured 1 year ago.

Looks similar

Screenshot of arxiv.org: LoMA: Lossless Compressed Memory Attention

LoMA: Lossless Compressed Memory Attention (arxiv.org)

90 points by PaulHoule 2 years ago | 8 comments

Screenshot of arxiv.org: Lossless LLM compression for efficient GPU inference via dynamic-length float

Lossless LLM compression for efficient GPU inference via dynamic-length float (arxiv.org)

392 points by CharlesW 1 year ago | 109 comments

arXiv paper introducing DFloat11, a lossless compression format that shrinks LLM weights by about 30% using entropy coding, with a custom GPU kernel for inference.

llm-compression dfloat11 bfloat16 entropy-coding

Screenshot of arxiv.org: Parameter-free KV cache compression for memory-efficient long-context LLMs

Parameter-free KV cache compression for memory-efficient long-context LLMs (arxiv.org)

60 points by PaulHoule 1 year ago | 13 comments

Screenshot of arxiv.org: KV Cache Compression 900000x Beyond TurboQuant and Per-Vector Shannon Limit

KV Cache Compression 900000x Beyond TurboQuant and Per-Vector Shannon Limit (arxiv.org)

40 points by EGreg 6 months ago | 11 comments

Screenshot of arxiv.org: DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via RL

DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via RL (arxiv.org)

1116 points by gradus_ad 1 year ago | 932 comments

arXiv abstract page for the DeepSeek-AI paper introducing DeepSeek-R1, which uses reinforcement learning to improve reasoning in large language models.

deepseek-r1 deepseek reinforcement-learning llm-reasoning

Screenshot of arxiv.org: Google Predicts the Flu Again

Google Predicts the Flu Again (arxiv.org)

7 points by tgoog 2 years ago | 6 comments

Looks similar

LoMA: Lossless Compressed Memory Attention(arxiv.org)

Lossless LLM compression for efficient GPU inference via dynamic-length float(arxiv.org)

Parameter-free KV cache compression for memory-efficient long-context LLMs(arxiv.org)

KV Cache Compression 900000x Beyond TurboQuant and Per-Vector Shannon Limit(arxiv.org)

DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via RL(arxiv.org)

Google Predicts the Flu Again(arxiv.org)