Skip to main content

Benchmarking Methodology: Distributed KV Cache over RoCE

Victor Teeter Odie Cavazos Metrum AI Broadcom Nov 13, 2026

See the benchmarking methodology and results for the distributed KV cache study, comparing RoCE vs. default TCP on two Dell PowerEdge XE9680 nodes and Broadcom 400 GbE networking.