Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of domain shift in federated 3D perception for autonomous driving by proposing FedCKA, a Centered Kernel Alignment (CKA)-based strategy for dynamic layer personalization. FedCKA computes layer-wise feature similarities to generate client-specific aggregation masks, enabling selective sharing of representation-consistent layers to mitigate the limitations of fixed personalization ratios. Experimental results on a multi-domain nuScenes benchmark demonstrate that FedCKA significantly outperforms existing federated baselines, achieving a 7-point improvement in average NDS.
Dynamic layer personalization via Centered Kernel Alignment unlocks superior federated 3D perception performance across diverse driving domains, outperforming fixed-ratio methods by 7 NDS points.
Robust perception in intelligent vehicles demands 3D object detectors that remain dependable under domain shifts, such as changes in time of day, location, or weather. However, due to costly annotation and rare shifts, some environments lack sufficient data to train a standalone detector. Federated learning offers a privacy-preserving framework for collaborative model training, enabling clients to benefit from shared learning across diverse environments. Yet, this framework traditionally relies on a single global consensus model, which struggles to perform across heterogeneous local data distributions. Local conditions are better captured by adapting a subset of the model, but many personalization approaches rely on predefined layer partitions or fixed personalization ratios, thereby limiting adaptation to client-specific divergence. To reduce this rigidity, we propose FedCKA, a Centered Kernel Alignment (CKA)-based strategy that dynamically handles the personalization-globalization trade-off. Specifically, FedCKA computes layer-wise feature similarities between local client models and the global consensus model during training. By converting layer-wise similarity scores into client-specific aggregation masks, FedCKA selectively shares representation-consistent layers. Evaluation on a unified multi-domain benchmark based on nuScenes shows that FedCKA outperforms established federated baselines, including FedBN, FedRep, and FedSelect, improving average NDS by 7 percentage points over the strongest baseline. The findings offer both a comparative benchmark and a promising direction for robust federated 3D perception across shifts in location, weather, and illumination. Code is available at https://github.com/j-verhoog/FedCKA.