Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
RoboFL establishes a federated learning framework for world-action models by assembling locally trained client LoRA adapters directly into a server-side Mixture of Slotted Adapters (MoSAIC). To prevent update entanglement and expert dilution across heterogeneous clients, the framework introduces foresight-to-action routing distillation (FARD) alongside path-consensus aggregation (PCEA) to redistribute compact global updates. In real-world Franka manipulation trials, RoboFL outperforms fully centralized PEFT training of InternVLA-A1 by 12.23% while reducing per-round client communication overhead by up to 86.81%.
Decentralized robotics data can yield stronger manipulation policies than centralized training: slotting locally trained client LoRAs directly into a server MoE beats centralized PEFT on real hardware by 12.23% while slashing communication by 87%.
Vision-language-action and world-action models are increasingly popular, yet remain bottlenecked by physical interaction data that is scarce, institutionally siloed, and task-heterogeneous. A natural federated solution is to let each client adapt a shared foundation model through parameter-efficient fine-tuning, avoiding the exchange of full-model updates. However, federating these adapters is nontrivial, as naive aggregation can entangle incompatible updates, while incorporating MoE-style routing into federated aggregation may dilute specialization and destabilize expert selection. We present RoboFL, which instantiates MoSAIC (Mixture of Slotted Adapters) for federated world-action learning. MoSAIC directly installs locally trained LoRA adapters as the expert branches of a server MoE. Server-side routers learn token assignments over these prior-informed branches while jointly refining routing and expert parameters. Foresight-to-Action Routing Distillation (FARD) aligns routing across the model's three paths, while Path-Consensus Expert Aggregation (PCEA) converts complete expert updates into a compact global adapter for personalized redistribution. Experiments on RoboTwin 2.0, RLBench, and a real-world Franka robot arm show the superiority of RoboFL with structured expert assembly, as it outperforms centralized PEFT InternVLA-A1 by 12.23% on the Franka arm, while reducing per-round client communication by up to 86.81% relative to MoE-based federated VLA baselines.