Search papers, labs, and topics across Lattice.
This paper introduces MultiPathFormer, an autoregressive foundation model that leverages multipath propagation as the core pretraining object for wireless signal tasks. By employing next-path prediction and integrating an Environmental RAG mechanism, the model significantly enhances path statistics estimation, achieving up to 59% improvement. MultiPathFormer demonstrates superior performance across various downstream tasks, outperforming state-of-the-art channel-based models and achieving notable metrics in localization, beam accuracy, and channel estimation.
Path-level pretraining in MultiPathFormer leads to a dramatic 59% improvement in wireless propagation estimations, reshaping the landscape of wireless foundation models.
Recent advances in machine learning have enabled training of wireless foundation models, which aim to support tasks such as channel estimation, beam prediction, and localization based on wireless signals. Existing wireless foundation models typically pretrain on channel tensors using masked reconstruction over subcarriers, antennas, or time but ignore the physical characteristics of wireless propagation. In this work, we propose to instead use multipath propagation as the fundamental pretraining object. We present MultiPathFormer, an autoregressive foundation model that represents each transmitter-receiver link as an ordered sequence of continuous-valued path tokens and pretrains with next-path prediction. We introduce an Environmental RAG (retrieval-augmented generation) mechanism and a first-path codebook on top of the transformer backbone, leveraging environment knowledge to improve path statistics estimation like delay and power by up to 59%. MultiPathFormer pretrained on 27 environments transfers to unseen users and, after scenario-specific fine-tuning, outperforms training the corresponding models from scratch in new environments. Across downstream tasks, it outperforms SOTA channel-based foundation models, achieving 5.57 m mean localization error, 0.914 top-3 beam accuracy, 0.994 line-of-sight classification accuracy, and 0.561 channel estimation NMSE. These results show that path-level pretraining can learn reusable representations of wireless propagation.
CMU ML