Two RTX 5090 hosts sharing a KV cache over Ethernet(viiwork.pulu.app)
4 points by velmu | 1 comments
A viiwork blog post benchmarking KV-cache sharing between two RTX 5090 LLM hosts over 1 GbE versus 10 GbE links for coding-agent workloads.
#viiwork on Hacker News
1 story tagged viiwork, newest first.