Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
MotionDLO is a real-time tracking framework that integrates event-based and frame-based approaches to enhance the tracking of moving deformable linear objects (DLOs). By leveraging the high temporal resolution of event cameras and the spatial accuracy of frame-based methods, the system achieves robust and temporally consistent shape estimation with a low computational overhead. Experimental results indicate that MotionDLO can perform updates at 12 ms intervals while maintaining a point-to-curve error of only 0.43 mm, facilitating effective robotic manipulation tasks.
Achieving real-time tracking of deformable objects with a remarkable accuracy of 0.43 mm could revolutionize robotic manipulation capabilities.
Reliably tracking moving deformable linear objects (DLOs) while simultaneously ensuring robustness, accuracy, and temporally consistent state estimation remains a fundamental challenge in robot perception. We introduce MotionDLO, a real-time tracking framework specifically designed to overcome these limitations in temporal continuity and latency. The method exploits the high temporal resolution and sparsity of event-based cameras and combines segmentation with the Coherent Point Drift (CPD) algorithm under the principles of Motion Coherence Theory. This integration enables temporally consistent shape estimation while maintaining a low computational overhead. Existing event-based tracking methods are typically computationally efficient but exhibit reduced accuracy compared to frame-based approaches, or alternatively compromise event sparsity to achieve competitive performance. To resolve this trade-off, we propose a hybrid event- and frame-based tracking architecture that preserves the complementary strengths of both sensing modalities. The event stream ensures high-frequency motion updates, while frame-based information stabilizes spatial accuracy and object identity. We demonstrate that the proposed framework reliably associates DLO instances across video sequences, enabling robust perception for robotic manipulation tasks. Experimental results validate real-time performance at 12 ms update rates and accurate shape tracking with an point-to-curve error as measurement of accuracy of up to 0.43 mm, supporting dynamic path adaptation during manipulation. The source code and demonstration datasets are publicly available.