Search papers, labs, and topics across Lattice.
This paper introduces GazeLNN, a lightweight scanpath prediction model that utilizes Liquid Neural Networks and MobileNetV3 to efficiently predict human-like visual attention in autonomous navigation. By operating auto-regressively to generate fixation heatmaps based on visual stimuli and fixation history, GazeLNN achieves a remarkable 0.47 ScanMatch score on the MIT Low Resolution dataset while reducing computational costs by 99.40% and increasing inference speed by up to six times. The model's integration into a reinforcement learning-based active camera-robot control policy demonstrates its practical application in enhancing robot autonomy through human-fixation-guided perception in real-world scenarios.
Achieving state-of-the-art attention prediction with 99.40% lower computational costs, GazeLNN transforms how robots perceive and navigate their environments.
Human visual attention relies on structured scanpaths to efficiently process scenes, yet instilling this behavior into robot autonomy is in its infancy and hindered by the high,computational costs of existing predictive models. To address this, we introduce GazeLNN, a computationally lightweight,scanpath prediction model that leverages Liquid Neural Networks as its recurrent engine and employs MobileNetV3 for feature extraction. Operating auto-regressively, the architecture predicts sequential fixation heatmaps conditioned on the current visual stimulus and fixation history. Despite requiring only 0.61 GFLOPs, GazeLNN achieves state-of-the-art performance on the MIT Low Resolution dataset achieving 0.47 ScanMatch score. It outperforms existing recurrent baselines across diverse evaluation metrics, while reducing computational costs by 99.40% and accelerating inference by up to six times. To investigate the role of human attention modeling in robot autonomy and demonstrate the practical utility of this highly efficient architecture, we integrate GazeLNN into an active camera-robot control policy trained via Reinforcement Learning. This integration enables human-fixation-guided perception during autonomous navigation, validated through successful real-world deployments on an aerial robot.
