Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces WiFi-JEPA, a self-supervised learning framework that enhances WiFi Channel State Information (CSI) for 3D human pose estimation in environments lacking cameras. By utilizing a novel approach of predicting masked latent embeddings and employing a ray-tracing simulation pipeline for generating unlabeled CSI data, WiFi-JEPA addresses the limitations of existing methods that struggle with environmental shifts and require costly annotations. The framework achieves state-of-the-art performance on the Person-in-WiFi-3D benchmark, demonstrating significant improvements over previous WiFi-CSI baselines for both single and multi-person scenarios.
WiFi-JEPA outperforms traditional methods by leveraging self-supervised learning to create robust 3D human pose estimations from WiFi signals, even in challenging environments.
WiFi Channel State Information (CSI) enables privacy-preserving human pose sensing in camera-denied environments, but existing WiFi-based pose estimators often fail under environment shifts and rely on costly camera-based annotation pipelines that limit scale. We propose WiFi-JEPA, a self-supervised framework that learns CSI-native representations by predicting masked latent embeddings instead of reconstructing raw CSI signals that may contain hardware-specific artifacts. WiFi-JEPA makes three contributions: (i) CSI-specific tokenization and link masking tailored to the CSI tensor over channel, time, and link (C,T,L); masking entire Tx-Rx antenna links forces the model to predict one spatial link view from others, capturing cross-link correlations informative of 3D spatial structure. (ii) A ray-tracing CSI simulation pipeline that generates diverse unlabeled CSI from randomized geometric primitives, providing scalable pre-training data without pose annotations. (iii) State-of-the-art results on Person-in-WiFi-3D: WiFi-JEPA outperforms prior WiFi-CSI baselines on both single- and multi-person 3D pose estimation under the same evaluation protocol. We also show that simulated CSI provides complementary pre-training signal to real CSI, and that four vision-native SSL objectives degrade performance below training from scratch, whereas WiFi-JEPA consistently improves downstream pose estimation.