Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces motion-based tokenization for egocentric gaze modeling, addressing the challenge of representing gaze data across different datasets. By formulating an event-aligned, fixed-horizon angular displacement as a motion vocabulary, the authors demonstrate that this approach yields lower target-domain regret compared to traditional vector-quantized tokens in certain transfer scenarios. The findings highlight the importance of event construction in gaze representation, revealing that different methods significantly impact transferability and predictive performance across datasets.
Angular-motion tokens outperform traditional gaze representations in transferability, revealing the critical role of event construction in gaze modeling.
Gaze is increasingly used as an input signal for vision and multimodal models, yet no consensus exists on how to represent it across datasets. Raw traces preserve detail but are noisy and device-dependent, while coarse event labels are easy to model but can discard local motion structure. We formulate event-aligned, fixed-horizon angular displacement as an interpretable, event-conditioned motion vocabulary and compare it with event-only, spatial, absolute-angle, learned vector-quantized, and continuous representations. To assess transfer alongside target predictability and token collapse, our evaluation combines next-token prediction with target-domain regret, low-order target references, paired bootstrap, order sensitivity, motif overlap, and frozen structural probes. In an event-aligned headset benchmark, angular-motion tokens have lower target-domain regret than frozen-codebook VQ tokens in one transfer direction, while the reverse direction is inconclusive. The probes reveal complementary representation properties, and event-only tokens show that low perplexity can retain little motion information. On a third egocentric dataset, a matched comparison of I-VT, native, and frame-span interfaces shows that event construction materially changes transfer: native events have the lowest regret into EGTEA, while frame-span events have zero motif overlap and fail severely as a source. Motion-based tokenization therefore provides a compact representation for event-aligned egocentric gaze streams, while the evaluation identifies how target predictability and event construction shape cross-dataset conclusions.