Search papers, labs, and topics across Lattice.
This paper conducts a comprehensive systematization of knowledge (SoK) on motion data privacy in Extended Reality (XR), analyzing 134 relevant studies to address the growing privacy concerns associated with motion tracking. It highlights how adversaries can exploit recorded motion patterns to infer sensitive information, while also categorizing various motion modalities and their associated risks. The findings culminate in a proposed taxonomy, an XR motion threat model, and guidelines for future research, emphasizing the urgent need for robust privacy mechanisms in XR applications.
Motion tracking in XR could expose users to significant privacy breaches, with adversaries able to infer sensitive information from seemingly innocuous motion patterns.
Extended Reality (XR) provides immersive, interactive 3D experiences. To enable these experiences, the devices must track user motion so the system can respond to actions such as grabbing, looking at, or moving an object. However, motion tracking has raised privacy concerns since it records a person's motion patterns. These motion patterns have been studied extensively across various fields (i.e., gait identification and profiling) and have been shown to reveal sensitive information. With the adoption of XR, these patterns became easier to record and obtain than ever. This creates a fundamental privacy tension: motion tracking enables core XR functionality yet requires users to compromise their privacy. Prior systematization-of-knowledge (SoK) studies on XR privacy have examined the field broadly, with motion-related research distributed across several privacy domains rather than treated as a distinct area of study. However, XR motion privacy has gained significant momentum since the prior SoK, with the literature nearly quadrupling in size and thereby warranting a dedicated systematization of this topic. This SoK examines 134 relevant papers on privacy concerns in motion patterns recorded by XR headsets, including how adversaries can obtain users'motion patterns, the inferences they can draw from them, and methods for protecting users. Based on this review, we synthesize a taxonomy of motion modalities, representations, and inference risks; develop an XR motion threat model; systematize the attack and defense approaches in the XR motion literature; identify gaps in the literature; and provide guidelines for future studies evaluating motion privacy mechanisms. Together, our SoK clarifies the state of XR motion privacy and provides recommendations for future evaluations.