KV Cache Is Becoming the Memory Hierarchy of Inference (touchdown-labs.com) | HN Screenshots

YHacker Newsscreenshots

Screenshot of touchdown-labs.com: KV Cache Is Becoming the Memory Hierarchy of Inference

First screen, captured 5 months ago.

Looks similar

Screenshot of fergusfinn.com: Speculative KV coding: losslessly compressing KV cache by up to ~4×

Speculative KV coding: losslessly compressing KV cache by up to ~4×(fergusfinn.com)

137 points by kkm 4 months ago | 28 comments

Screenshot of blog.cloudflare.com: Cloudflare's AI Platform: an inference layer designed for agents

Cloudflare's AI Platform: an inference layer designed for agents (blog.cloudflare.com)

300 points by nikitoci 6 months ago | 80 comments

Screenshot of ngrok.com: Prompt caching for cheaper LLM tokens

Prompt caching for cheaper LLM tokens (ngrok.com)

268 points by samwho 10 months ago | 67 comments

Screenshot of codewall.ai: How we hacked McKinsey's AI platform

How we hacked McKinsey's AI platform (codewall.ai)

420 points by mycroft_4221 7 months ago | 168 comments

CodeWall blog post describing how its autonomous offensive agent found vulnerabilities in McKinsey's internal AI platform Lilli.

mckinsey lilli ai-security penetration-testing

Screenshot of inco.ai: DFlash 2: Keep Drafting Parallel

DFlash 2: Keep Drafting Parallel (inco.ai)

85 points by mike-the-brain 2 months ago | 12 comments

Screenshot of blog.coredump.cx: How much of HN is AI?

How much of HN is AI?(blog.coredump.cx)

203 points by surprisetalk 2 months ago | 199 comments