Search papers, labs, and topics across Lattice.
This paper introduces EventGait, a dual-stream framework for gait recognition using event cameras, designed to separately model motion dynamics and static shape. The dynamic stream uses a Mixture of Spiking Experts (MoSE) to handle complex motion and illumination, while the static stream employs Cross-modal Structure Alignment (CroSA) with vision foundation models for shape representation. The authors also synthesize and release two new event-based gait datasets, SUSTech1K-E and CCGR-Mini-E, demonstrating that EventGait achieves state-of-the-art performance, particularly in low-light conditions, surpassing traditional camera-based methods.
Event cameras unlock robust gait recognition even in challenging low-light conditions, outperforming traditional cameras by separately modeling motion dynamics and static shape.
Gait recognition enables non-intrusive, privacy-preserving identification but suffers in uncontrolled environments due to illumination and motion sensitivity of conventional cameras. In this work, we explore gait recognition using event cameras, which offer microsecond temporal resolution and high dynamic range, naturally capturing robust dynamic cues and suppressing static noise. Existing event-based approaches typically aggregate event streams into event images over long time windows, thereby discarding fine-grained motion dynamics critical for gait recognition. Therefore, we propose \textbf{EventGait}, an end-to-end dual-stream framework that separately models motion and shape while preserving the advantages of events. Our dynamic stream leverages a Mixture of Spiking Experts (MoSE) with diverse neuron constants for robust dynamic perception across complex motion and illumination scenes, while the static stream learns dense shape representations via Cross-modal Structure Alignment (CroSA) with large vision foundation models. To address the absence of large-scale event-based gait datasets, we introduce a synthesis pipeline and release two new benchmarks: SUSTech1K-E and CCGR-Mini-E. Extensive experiments have shown that event-based gait recognition not only achieves results comparable to camera-based gait recognition under normal conditions but also significantly outperforms it in low-light scenarios. Our approach sets a new state of the art on both synthesized and real-world event-based gait benchmarks, highlighting the robustness and potential of event-driven gait analysis. The code and datasets are released at https://github.com/QUEAHREN/EventGait.
