Search papers, labs, and topics across Lattice.
This study reveals a novel privacy vulnerability in virtual reality (VR) systems by utilizing unrestricted inbuilt motion sensors to reconstruct unobservable brainwave data, specifically EEG-correlated representations. The researchers developed BraVeSpy, which captures subtle vibrations from user pupillary responses to infer visual stimuli and in-brain perceptions, achieving accuracy rates of 52.0%-67.2% in revealing perceptive images and over 85.0% in inferring sensitive user activities. This work highlights a significant gap in current privacy protections in the Metaverse, demonstrating that existing methods focused on observable behaviors are insufficient against sophisticated privacy breaches.
Uncovering that VR motion sensors can reconstruct unobservable brainwave data reveals a critical privacy vulnerability in the Metaverse.
Metaverse devices, such as virtual reality (VR), have seen substantial development and widespread applications in numerous areas. Although recent studies have revealed privacy leakages in VR, these vulnerabilities were limited in the scope of observable behaviors in virtual scenes (e.g., what a user is seeing). In this work, we uncover the feasibility of going beyond the scope of observable user behaviors to unobservable brain EEG-correlated representations (e.g., what a user is perceiving) by leveraging unrestricted motion sensors in VR headsets to reconstruct brain EEG signals, a seemingly neglected but promising vector. The insight is that the inbuilt motion sensors (e.g., accelerometers) in the VR headset can capture subtle vibrations induced by pupillary responses, which are highly correlated with users' visual stimuli and in-brain perceptions. Therefore, we design and implement BraVeSpy to systematically investigate and demonstrate the feasibility of this severe privacy leakage originating from brain EEG-correlated representations reconstructed from variations of inbuilt motion sensors. Our extensive evaluation results from different VR devices show that BraVeSpy, for the first time in the Metaverse, can reveal unobservable privacy, where we successfully unveiled perceptive images in the brain with 52.0%-67.2% accuracy. In particular, we also find that BraVeSpy outperforms the current approaches that are limited to coarse-grained inference of observable behaviors and achieves over 85.0% accuracy in inferring user activity-related sensitive information, such as fingerprinting websites, apps, and streaming videos, and over 96.0% accuracy in user de-anonymization, gaze movement tracking, and virtual keystroke inference.
NUS