16-Bit to 1-Bit: Visual KV Cache Quantization for Efficient Multimodal LLMs (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: 16-Bit to 1-Bit: Visual KV Cache Quantization for Efficient Multimodal LLMs

First screen, captured 1 year ago.

Looks similar

Screenshot of arxiv.org: 26× Faster Inference with Layer-Condensed KV Cache for Large Language Models

26× Faster Inference with Layer-Condensed KV Cache for Large Language Models (arxiv.org)

112 points by georgehill 2 years ago | 16 comments

Screenshot of arxiv.org: VLMaterial: Procedural Material Generation with Large Vision-Language Models

VLMaterial: Procedural Material Generation with Large Vision-Language Models (arxiv.org)

16 points by eamag 1 year ago | 0 comments

Screenshot of arxiv.org: LM2: Large Memory Models

LM2: Large Memory Models (arxiv.org)

105 points by fzliu 1 year ago | 30 comments

Screenshot of arxiv.org: δ-mem: Efficient Online Memory for Large Language Models

δ-mem: Efficient Online Memory for Large Language Models (arxiv.org)

227 points by 44za12 5 months ago | 58 comments

Screenshot of arxiv.org: Parameter-free KV cache compression for memory-efficient long-context LLMs

Parameter-free KV cache compression for memory-efficient long-context LLMs (arxiv.org)

60 points by PaulHoule 1 year ago | 13 comments

Screenshot of arxiv.org: Efficient Memory Management for Large Language Model Serving with PagedAttention

Efficient Memory Management for Large Language Model Serving with PagedAttention (arxiv.org)

87 points by jmorgan 3 years ago | 17 comments