Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
InfiniHand replaces disjointed SLAM and hand-pose cascades with an end-to-end feed-forward streaming network that jointly tracks camera trajectories, 3D hand locations, and MANO mesh parameters directly from uncalibrated egocentric video. By integrating persistent spatiotemporal memory with hand-centered visual representations and training across 5,000 hours of video, the architecture mitigates error accumulation and severe computational overhead inherent to multi-stage pipelines. The resulting model achieves an 11.19 FPS streaming throughput—more than double HaWoR—while cutting ARCTIC PA-p tracking error by 21.4% compared to ViDiHand.
Ditching brittle hand-estimator-plus-SLAM cascades for an end-to-end streaming memory network slashes world-space hand tracking error by 21.4% while doubling inference throughput.
World-space hand motion estimation from egocentric video requires recovering 3D articulated hand geometry while tracking camera egomotion. Existing approaches heavily rely on cascading independent hand pose estimators and SLAM systems, resulting in error accumulation, complex pipelines, and severe computational overhead. To address these limitations, we present InfiniHand, an end-to-end streaming feed-forward framework that jointly estimates MANO parameters, camera trajectories, and hand locations directly from uncalibrated egocentric video. InfiniHand integrates persistent spatiotemporal memory with hand-centered visual features, explicitly coupling camera motion with local hand geometry within a unified architecture. We train InfiniHand in two progressive stages by first learning robust camera-space hand priors and then extending to streaming world-space reconstruction. To support this process, we aggregate a pretraining corpus of approximately 5,000 hours of egocentric data across multiple public datasets. Extensive evaluations demonstrate that InfiniHand outperforms state-of-the-art baselines on in-domain benchmarks, achieving a 21.4% reduction in ARCTIC PA-p compared to ViDiHand while substantially mitigating world-space drift. Furthermore, InfiniHand generalizes robustly to in-the-wild videos and operates at 11.19 FPS, delivering more than twice the throughput of HaWoR.