Search papers, labs, and topics across Lattice.
This paper introduces the AC$^2$P$^2$SL framework, which enhances split learning in wireless edge networks by integrating adaptive communication and computation processes into a unified pipeline. By employing fine-grained pipeline parallelism and optimizing resource allocation, the framework significantly reduces training latency while maintaining user data privacy. Experimental results confirm that AC$^2$P$^2$SL effectively minimizes training time and adapts to dynamic environments, showcasing its robustness and efficiency in edge computing scenarios.
Achieving substantial reductions in training latency, AC$^2$P$^2$SL redefines the efficiency of split learning in edge networks without compromising data privacy.
In wireless edge networks, split learning (SL) enables base station (BS) to utilize the distributed data and computing power across user equipments (UEs) to achieve collaborative model training while protecting local data privacy. However, the inherent sequential execution of computation and communication processes in conventional SL usually leads to long training times. To overcome this limitation, this paper proposes an adaptive communication-computation pipeline parallel split learning (AC$^2$P$^2$SL) framework. By conceptualizing the communication and computation processes of UEs and the BS as a unified pipeline, AC$^2$P$^2$SL achieves fine-grained pipeline parallelism across multiple micro-batches. Through this approach, effective overlapping of communication and computation is achieved which results in significant reduction of the overall training latency. Moreover, by considering the system constraints in the communication, computation, and storage dimensions as well as the heterogeneity of UEs, we formulate a joint optimization problem to minimize the training time and propose a corresponding split and pre-allocation algorithm to further enhance the pipeline efficiency. Additionally, accounting for the practical dynamic environments for the UEs, we design an adaptive re-allocation strategy to enhance the system resilience. Extensive experimental results demonstrate the effectiveness and robustness of AC$^2$P$^2$SL in reducing training time while ensuring data privacy preservation.
