Search papers, labs, and topics across Lattice.
This paper analyzes the performance of a virtualized XRootD frontend architecture at the T2_BR_SPRACE storage system, which aggregates data from a dCache backend to a 100 Gb/s WAN link. The system, utilizing BBR congestion control and TCP extensions, achieved an aggregate throughput of 51.3 Gb/s under peak production conditions. A specific data flow to Fermilab reached peaks of 41.5 Gb/s, demonstrating the viability of virtualized architectures for high-throughput data transfer in large-scale WAN environments.
A virtualized XRootD frontend can sustain over 50 Gb/s throughput in real-world large-scale WAN transfers, challenging assumptions about virtualization overhead in high-performance data systems.
This paper presents a detailed case study of the T2_BR_SPRACE storage frontend architecture and its observed performance in high-intensity data transfers. The architecture is composed of a heterogeneous cluster of XRootD [1] Virtual Machines (VMs) with 10 Gb/s and 40 Gb/s links, which aggregate data from a 77 Gb/s dCache [2] backend via pNFS to an external 100 Gb/s WAN link. We describe the system configuration, including the use of the BBR [3] congestion control algorithm and TCP extensions [4]. Under peak production conditions, we observed the system sustaining an aggregate throughput of 51.3 Gb/s. An analysis of a specific data flow to Fermilab (FNAL) showed peaks of 41.5 Gb/s, validated by external monitoring tools (CERN). This study documents the performance of a complex virtualized architecture under real load.