Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces LatentWave, a wireless foundation model that utilizes a Joint-Embedding Predictive Architecture (JEPA) to pretrain on diverse wireless spectrograms and channel state information (CSI). By predicting masked regions in latent space, LatentWave generates more transferable representations for various downstream tasks, outperforming a baseline model, WavesFM, in RF signal classification, 5G NR positioning, beam prediction, and LoS/NLoS classification. The architecture's innovative use of per-channel patch embeddings and stochastic channel sampling enhances its adaptability to different wireless configurations, addressing limitations in existing masked input reconstruction methods.
LatentWave achieves superior transferability across wireless tasks by leveraging a novel predictive architecture that learns in latent space, challenging traditional masked input approaches.
Wireless foundation models have emerged as a promising alternative to building separate models for each wireless task. However, existing approaches rely on masked input reconstruction, which can bias representations toward low-level signal details. In this paper, we propose LatentWave, a wireless foundation model pretrained using a Joint-Embedding Predictive Architecture (JEPA) on diverse wireless spectrograms and channel state information (CSI). By predicting masked regions in latent space, LatentWave learns representations that are more transferable out of the box across diverse downstream tasks. The proposed architecture employs per-channel patch embeddings with stochastic channel sampling during pretraining, allowing it to process variable antenna counts and improving usability across heterogeneous wireless configurations. We evaluate LatentWave on four downstream tasks: RF signal classification, 5G NR positioning, beam prediction, and LoS/NLoS classification, comparing against a masked-modeling baseline (WavesFM) pretrained on the same data. Additionally, we show that the masking geometry introduces a task-dependent inductive bias: frequency masking strongly favors channel-related tasks such as positioning and beam prediction, while region masking better preserves discriminability for signal classification.