Two RTX 5090 hosts sharing a KV cache over Ethernet(viiwork.pulu.app)
4 points by velmu | 1 comments
A viiwork blog post benchmarking KV-cache sharing between two RTX 5090 LLM hosts over 1 GbE versus 10 GbE links for coding-agent workloads.
1 story on the front page, newest first. Scroll down to watch the site change over time.
4 points by velmu | 1 comments
A viiwork blog post benchmarking KV-cache sharing between two RTX 5090 LLM hosts over 1 GbE versus 10 GbE links for coding-agent workloads.