YHacker Newsscreenshots

vllm.ai on Hacker News

4 stories on the front page, newest first. Scroll down to watch the site change over time.

Screenshot of vllm.ai: Speculative Decoding in vLLM on AMD GPUs

Speculative Decoding in vLLM on AMD GPUs (vllm.ai)

130 points by ankitg12 1 month ago | 47 comments

Screenshot of vllm.ai: Micro-Agent: Beat Frontier Models with Collaboration Inside Model API

Micro-Agent: Beat Frontier Models with Collaboration Inside Model API (vllm.ai)

64 points by matt_d 3 months ago | 19 comments

Screenshot of vllm.ai: Eagle 3.1: Collaboration Between the EAGLE Team, vLLM Team, and TorchSpec Team

Eagle 3.1: Collaboration Between the EAGLE Team, vLLM Team, and TorchSpec Team (vllm.ai)

60 points by berlianta 5 months ago | 20 comments

Screenshot of vllm.ai: vLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention

vLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention (vllm.ai)

260 points by wskwon 3 years ago | 39 comments