Skip to main content

Distributed KV Cache over RoCE: Multi-Node LLM Inference on Dell and Broadcom

Metrum AI Nov 17, 2026

Distributed KV-cache transfers for disaggregated LLM inference are evaluated, comparing RoCE with default TCP on two Dell PowerEdge XE9680 nodes and Broadcom 400 GbE networking.