Search papers, labs, and topics across Lattice.
This paper introduces Collective-State JEPA (CS-JEPA), a decentralized predictive architecture enabling robots in a swarm to collectively predict future states based solely on local observations and limited communication. By leveraging a recurrent joint-embedding approach, CS-JEPA significantly enhances prediction accuracy and inter-robot agreement without requiring global pooling or extensive labeled data. The results demonstrate a 45.5% reduction in branch-value mean squared error and improved correlation in predictive representations, showcasing its effectiveness in label-efficient decentralized swarm prediction across various scenarios.
CS-JEPA achieves unprecedented label-efficient collective-state prediction in decentralized robot swarms, outperforming traditional methods with significantly fewer parameters.
Can every robot in a swarm predict the same future collective state from only local observations and bandwidth-limited messages? We formulate this as decentralized shared-state prediction and introduce Collective-State JEPA (CS-JEPA), a recurrent joint-embedding predictive architecture whose output at every robot represents one common future token field. At deployment, each robot uses a 16-frame local history and one 64-float recurrent message per directed edge; there is no global pooling, target encoder, episode clock, or recorded future action. After pretraining without downstream collective labels, frozen representations are evaluated with ridge probes fitted on 6, 12, or 24 globally labeled episodes. Against raw-future reconstruction with the same receiver anchor and deployment capacity but 9,607 additional training-only parameters, a prospectively registered five-seed follow-up improves prediction-error and inter-robot-agreement label-budget AUC on in-distribution, ring, mutual-kNN, and unseen-size families up to 108 robots. Every effect favors CS-JEPA in 5/5 outer seeds. In a separate sealed eight-seed follow-up, matched action-conditioned predictors receive each candidate four-step plan before producing receiver-local predictive representations. CS-JEPA reduces branch-value MSE by 45.5% and improves within-context candidate-score Pearson correlation by 0.1291, with both effects favorable in 8/8 seeds, including at unseen N=32. These results support common-future JEPA targets as a label-efficient primitive for decentralized swarm prediction under topology and size shift, with additional evidence of planning-relevant value estimation.
