Benchmarking Methodology: Distributed KV Cache over RoCE
See the benchmarking methodology and results for the distributed KV cache study, comparing RoCE vs. default TCP on two Dell PowerEdge XE9680 nodes and Broadcom 400 GbE networking.
See the benchmarking methodology and results for the distributed KV cache study, comparing RoCE vs. default TCP on two Dell PowerEdge XE9680 nodes and Broadcom 400 GbE networking.