Two RTX 5090 hosts sharing a KV cache over Ethernet(viiwork.pulu.app)
4 points by velmu | 1 comments
A viiwork blog post benchmarking KV-cache sharing between two RTX 5090 LLM hosts over 1 GbE versus 10 GbE links for coding-agent workloads.
1 story tagged 10-gbe, newest first.
4 points by velmu | 1 comments
A viiwork blog post benchmarking KV-cache sharing between two RTX 5090 LLM hosts over 1 GbE versus 10 GbE links for coding-agent workloads.