Search papers, labs, and topics across Lattice.
The authors developed AVP-Inspect, an automated dynamic analysis framework that combines custom physical actuation hardware with a 3D UI exploration engine to intercept and audit network traffic from commercial Apple Vision Pro applications. This addresses a critical auditing blind spot created by Apple's closed visionOS ecosystem despite the severe privacy risks posed by pervasive spatial and multimodal data harvesting. Evaluating 324 App Store applications revealed that 58.0% commit at least one privacy violation, with over 60% of network traffic flows completely undisclosed to users.
Apple's walled garden fails to prevent XR data leaks: 58% of audited Vision Pro applications secretly transmit sensitive user traffic without mandatory privacy disclosures.
XR devices introduce substantial privacy concerns due to their comprehensive data collection capabilities that surpass traditional computing platforms. While existing works have demonstrated privacy concerns on Android-based XR devices such as Meta Quest series by performing network traffic analysis, little attention has been paid to the Apple Vision Pro (AVP) devices, mainly due to the closed nature and the technical challenges associated with AVP devices. In this work, we make a bold attempt to detect privacy violations of AVP applications from network traffic through automatic testing on AVP devices. Our key insight is that effective AVP application testing requires coordinated control of both cyber (software) and physical (hardware) components, which we term Coordinated Cyber-Physical Testing. Building on this insight, we design and implement AVP-Inspect, an automatic dynamic analysis framework for AVP applications, overcoming significant challenges enforced by the closed-source nature of AVP ecosystem. AVP-Inspect consists of three components: an automatic device controller by building customized hardware devices, a 3D UI explorer by designing a new exploration engine, and a privacy violation detector by constructing a unified privacy taxonomy for AVP. We first evaluated AVP-Inspect on a manually constructed ground truth dataset, then performed a large-scale analysis on 324 AVP applications downloaded from the App Store, with each app tested for 20 minutes. We found that 188 (58.0%) of apps exhibit at least one violation, and more than 60% of the network traffic flows are not properly disclosed.
