Search papers, labs, and topics across Lattice.
This paper introduces FedSGA, an adaptive split federated learning framework that optimizes model training by estimating client-specific sufficiency through a novel shallow sufficiency estimator. By utilizing private prompt tokens to track local adaptation dynamics and a harmonization module for interface compatibility, FedSGA effectively addresses the challenges posed by client heterogeneity in data distributions and adaptation states. Experimental results show that FedSGA significantly enhances model performance while minimizing computational overhead for clients compared to existing methods.
Client-specific sufficiency estimation in FedSGA allows for more efficient federated learning, boosting performance while slashing unnecessary computation costs.
\textit{Split Federated Learning} (SFL) enables distributed model training by splitting networks between the server and clients. However, under client heterogeneity, the conventional static split strategy may be suboptimal because clients can differ in data distributions, adaptation dynamics, and representation learning progress, making a single split point insufficient to accommodate client-specific training states. In this paper, we propose \textsc{FedSGA}, a \textbf{S}ufficiency-\textbf{G}uided \textbf{A}daptive split \textbf{Fed}erated learning framework that addresses this question through client-specific shallow sufficiency estimation. First, we introduce a client-specific adaptation channel based on private prompt tokens, which tracks local adaptation dynamics separately from the shared backbone and provides a lightweight signal for detecting whether client adaptation remains active. To further avoid repeated online probing over multiple candidate depths, we design a shallow sufficiency estimator that combines cross-client semantic alignment, temporal interface stability, and prompt-state variation to estimate whether the shallowest split is already sufficient. Finally, we introduce a split-compatible interface harmonization module that projects activations from different split depths into a shared semantic space, improving the comparability of heterogeneous client interfaces before server-side prediction. Extensive experiments on multiple heterogeneous benchmarks demonstrate the effectiveness of \textsc{FedSGA} in improving model performance compared with state-of-the-art methods while reducing unnecessary client-side computation.
