Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper empirically investigates ORDERS, a personalized federated learning configuration combining a shared backbone with private adapters and classifiers, weighted by descending update norm. The study aims to disentangle the server weighting rule's impact from local training choices by performing extensive evaluations across configurations and datasets. ORDERS shows competitive performance, achieving $80.51 \pm 0.79\%$ native mean client accuracy on CIFAR-10, slightly outperforming FedPer-R1 and a uniform-weight control, though gains diminish after local fine-tuning.
Geometric weighting by update norm offers a subtle but measurable improvement in personalized federated learning, outperforming uniform aggregation and FedPer-R1 on CIFAR-10's native client accuracy.
Personalized federated learning combines shared representations with client-specific predictors, but the contribution of a server weighting rule can be obscured by local training and evaluation choices. We study ORDERS, a configuration that combines a shared backbone, a private residual adapter and classifier, geometric weights assigned by descending update norm, feature alignment, and private-parameter perturbations. The server computes a weighted sum of updates obtained from the same broadcast model; it does not obtain an additional optimization effect from sequential addition. A fully specified evaluation comprises 80 final runs: eight configurations, two datasets, and five training seeds on one fixed partition per dataset. On two-class-per-client CIFAR-10, ORDERS achieves $80.51 \pm 0.79\%$ native mean client accuracy, compared with $79.02 \pm 1.42\%$ for FedPer-R1 and $80.27 \pm 0.73\%$ for the matched uniform-weight control. After common local fine-tuning, the difference from FedPer-R1 narrows to 0.32 percentage points. On Sent140, ORDERS reaches $74.71 \pm 0.49\%$, only 0.69 points above a post hoc client training-majority diagnostic. Ablations provide limited, endpoint-dependent evidence for norm ranking and alignment, and no clear benefit from perturbations. Parameter-payload savings are 5.47% and 0.78%, respectively.