Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
MonoEgo eliminates active tracking hardware and multi-device synchronization in robot demonstration capture by coupling a single 90-FPS global-shutter camera with passive wrist marker constellations and sparse workstation fiducials. To recover metric trajectory scale monocularly, the system employs MonoTag SLAM, combining marker corners with ORB features within an Atlas framework that executes scale re-anchoring, verified map merging, and retrospective pose recovery. Experimental evaluations show that the offline pipeline maintains metric tracking through anchor dropouts and reliably merges separated map components, proving that passive fixtures can substitute for complex multi-sensor rigs.
Robot imitation learning does not require cumbersome active tracking suits: a single monocular camera observing passive wrist markers and sparse workspace fiducials can reconstruct metric 6-DoF trajectories offline.
Image-aligned metric demonstrations often require dedicated tracking hardware and synchronization across devices. We present MonoEgo, a capture system that replaces active wrist instrumentation with offline monocular reconstruction. One 90-FPS global-shutter camera observes calibrated passive wrist constellations, sparse workstation anchors, and the scene on a shared image clock. MonoTag SLAM combines marker corners with ORB geometry and uses visual evidence to reject ambiguous planar-marker poses. Its metric Atlas supports interval scale re-anchoring, verified map merging, and retrospective localization of earlier frames supported by the final map. Camera and wrist-constellation outputs retain validity and map provenance, and unsupported motion is left missing. Experiments show metric tracking beyond continuous anchor visibility, reconnection of supported map components, and recovery of some missing camera poses. Comparisons against a multisensor camera reference and separate stationary-constellation tests characterize trajectory agreement and precision while revealing incomplete coverage and residual geometric uncertainty. The results indicate that passive fixtures and offline reconstruction can reduce capture-side requirements. Dynamic accuracy, deployment, and downstream policy benefits require further study.