Search papers, labs, and topics across Lattice.
This paper introduces EnsembleGaze, an unsupervised ensemble learning system that employs consensus clustering to analyze free-viewing gaze data, addressing the underexplored area of human-information interaction. By utilizing statistical descriptors of fixation distributions and implementing advanced clustering techniques, the study reveals that image stimuli consistently group into distinct viewing modes, while user groupings are influenced by specific image contexts. The findings highlight the importance of employing tailored clustering strategies to uncover nuanced patterns in gaze behavior, demonstrating significant dataset-specific insights.
Image stimuli consistently reveal robust viewing mode distinctions, while user behavior is intricately tied to specific contexts, showcasing the complexity of human gaze patterns.
Free-viewing gaze data provides a rich, task-free window into human visual attention. Conventional exploratory data analysis of the data provides user attention patterns through fixations and areas of interest. However, despite the richness of this gaze data, its human-information interaction (HII) patterns are understudied. We address this gap using consensus clustering of gaze data with respect to users and stimulus characteristics. We present a novel end-to-end unsupervised ensemble learning system for consensus clustering of free-viewing gaze datasets, EnsembleGaze. With a goal of characterizing the user behavior and stimulus type, we propose a feature engineering step based on statistical descriptors of fixation-based distributions. EnsembleGaze involves consensus voting of selected clustering methods implemented on the feature vector to compute the co-association matrix. Using the separate consensus clustering of users and stimuli as a baseline, we further propose two high-dimensional clustering strategies for determining gaze clusters based on joint user and image characterization. They are consensus subspace clustering and spectral biclustering. Clustering performance is evaluated using selected standard metrics and is further interpreted through image-level properties. Our system provides a replicable method for the unsupervised analysis of fixation behavior in scene perception research. Our results show that image stimuli groupings are highly consistent across methods, reflecting a robust ambient-versus-focal viewing mode distinction, whereas user groupings are image-context-dependent, a structure that only biclustering and the two-step conditional approaches are architecturally capable of recovering. Testing on the publicly available datasets revealed dataset-specific patterns, with each offering complementary insights through distinct clustering strategies.
