Search papers, labs, and topics across Lattice.
This paper addresses the coflow scheduling problem in multi-core Optical Circuit Switching (OCS) networks, which are increasingly used in data centers to handle large bandwidth demands. They develop an approximation algorithm that jointly optimizes cross-core flow assignment and per-core circuit scheduling to minimize total weighted coflow completion time (CCT) under the not-all-stop reconfiguration model. The algorithm provides a provable worst-case performance guarantee and is validated through trace-driven simulations using Facebook workloads, demonstrating significant reductions in weighted and tail CCT.
Optimizing coflow scheduling in multi-core optical networks can slash completion times for data-intensive jobs, and this algorithm proves it with real-world Facebook workload traces.
Coflow provides a key application-layer abstraction for capturing communication patterns, enabling the efficient coordination of parallel data flows to reduce job completion times in distributed systems. Modern data center networks (DCNs) are employing multiple independent optical circuit switching (OCS) cores operating concurrently to meet the massive bandwidth demands of application jobs. However, existing coflow scheduling research primarily focuses on the single-core setting, with multi-core fabrics only for EPS (electrical packet switching) networks. To address this gap, this paper studies the coflow scheduling problem in multi-core OCS networks under the not-all-stop reconfiguration model in which one circuit's reconfiguration does not interrupt other circuits. The challenges stem from two aspects: (i) cross-core coupling induced by traffic assignment across heterogeneous cores; and (ii) per-core OCS scheduling constraints, namely port exclusivity and reconfiguration delay. We propose an approximation algorithm that jointly integrates cross-core flow assignment and per-core circuit scheduling to minimize the total weighted coflow completion time (CCT) and establish a provable worst-case performance guarantee. Furthermore, our algorithm framework can be directly applied to the multi-core EPS scenario with the corresponding approximation ratio under packet-switched fabrics. Trace-driven simulations using real Facebook workloads demonstrate that our algorithm effectively reduces weighted CCT and tail CCT.
