Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a minimalist visual-inertial odometry (VIO) system for differential-drive robots using only four photodiodes with learned optical Gabor masks and an IMU. The key insight is that these photodiodes, when paired with optimized Gabor masks, can accurately encode speed information. By jointly optimizing the mask parameters and a Temporal Convolutional Network (TCN) in simulation, the system achieves robust planar odometry without real-world fine-tuning, validated across diverse terrains.
Just four photodiodes and an IMU are enough to achieve robust visual-inertial odometry for differential-drive robots, challenging the reliance on high-resolution cameras.
Visual-Inertial Odometry(VIO), which is critical to mobile robot navigation, uses cameras with a large number of pixels. Capturing and processing camera images requires significant resources. This work presents a minimalist approach to planar odometry, demonstrating that just four visual measurements and an IMU can provide robust motion estimation for differential-drive robots. Our key insight is that four downward-facing photodiodes that sense the world through optical Gabor masks produce signals that encode speed. Based on this, we jointly optimize the mask parameters alongside a Temporal Convolutional Network (TCN) using a physically-grounded simulator. The resulting model decodes speed from just the four measurements produced by the photodiodes. Pairing these estimates with the angular speed from an IMU yields a continuous planar trajectory. We validate our approach with a prototype sensor mounted on a differential drive robot. Across diverse indoor and outdoor terrains, our system closely tracks the reference ground truth without any real-world fine-tuning. Our work shows that minimalist sensing enables efficient and accurate planar odometry.