YHacker Newsscreenshots

blog.kog.ai on Hacker News

1 story on the front page, newest first. Scroll down to watch the site change over time.

Screenshot of blog.kog.ai: Real-time LLM Inference on Standard GPUs: 3k tokens/s per request

Real-time LLM Inference on Standard GPUs: 3k tokens/s per request (blog.kog.ai)

189 points by NicoConstant 5 months ago | 88 comments