Search papers, labs, and topics across Lattice.
This paper presents a novel, learning-free method for 6D object pose tracking that leverages the high temporal resolution of event cameras. The approach combines a pose propagation step using event-based optical flow to estimate 6D object velocity with a template-based local pose correction module. Experiments demonstrate that the proposed method achieves comparable or superior performance to state-of-the-art algorithms, especially for fast-moving objects, highlighting the potential of event cameras in dynamic scenarios.
Event cameras can now track 6D object poses at high speeds without learning, rivaling or exceeding RGB-D methods in dynamic environments.
Object pose tracking is a fundamental and essential task for robotics to perform tasks in the home and industrial settings. The most commonly used sensors to do so are RGB-D cameras, which can hit limitations in highly dynamic environments due to motion blur and frame-rate constraints. Event cameras have remarkable features such as high temporal resolution and low latency, which make them a potentially ideal vision sensors for object pose tracking at high speed. Even so, there are still only few works on 6D pose tracking with event cameras. In this work, we take advantage of the high temporal resolution and propose a method that uses both a propagation step fused with a pose correction strategy. Specifically, we use 6D object velocity obtained from event-based optical flow for pose propagation, after which, a template-based local pose correction module is utilized for pose correction. Our learning-free method has comparable performance to the state-of-the-art algorithms, and in some cases out performs them for fast-moving objects. The results indicate the potential for using event cameras in highly-dynamic scenarios where the use of deep network approaches are limited by low update rates.
