Search papers, labs, and topics across Lattice.
The paper introduces GazePrior, a data-driven 3D prior that models the distribution of human eyes to synthesize realistic eye-tracking data for zero-shot transfer to new AR/VR eye-tracking devices. GazePrior leverages sparse-input 3D reconstruction from existing annotated datasets to generate training data tailored to the target device's camera parameters. Experiments show that models trained on GazePrior-synthesized data outperform existing zero-shot methods in accuracy and robustness.
Skip the costly data collection for new eye-tracking devices: GazePrior synthesizes realistic training data by learning a 3D prior of human eyes, enabling zero-shot transfer.
Eye tracking (ET) is a foundational technology for advanced AR/VR applications. However, training ET models for every new ET device is challenging: real data collection is costly and time-consuming, while existing synthetic data generation methods lack realism. To remove the need for additional data collection while maintaining data quality, we introduce a data-driven 3D prior that models the distribution of human eyes across diverse identities, gaze directions, and light settings. This model, which we coin GazePrior, then enables sparse-input 3D reconstruction of annotated data collected with previous ET devices, which can in turn be rendered from the cameras of any target ET device. Our approach synthesizes data with the realism, diversity and ground-truth accuracy of real data collection without its prohibitive costs. Our experiments demonstrate that ET models trained with our synthesized data outperform previous zero-shot methods, achieving higher accuracy and robustness.
Meta AI