Search papers, labs, and topics across Lattice.
This paper introduces AISPO, a depth completion framework designed to enhance depth reliability for robotic manipulation of non-Lambertian objects, which often present challenges due to corrupted or missing depth measurements. By integrating multi-scale RGB-D feature fusion with an affine-invariant shape prior, AISPO prioritizes geometric consistency over mere average depth accuracy, leading to improved physical plausibility in depth maps. Benchmark evaluations and real-world experiments reveal that AISPO significantly boosts manipulation success rates, especially for transparent objects that typically confound existing methods.
AISPO transforms depth perception for robotic manipulation, achieving higher success rates with transparent objects that stymie conventional approaches.
Reliable depth perception is critical for robotic manipulation, especially for non-Lambertian objects such as transparent or highly specular surfaces, where raw depth measurements are often corrupted or missing. These failures frequently propagate to motion planning, resulting in invalid grasp poses and execution errors. We propose AISPO, a depth completion framework that improves depth reliability for manipulation in challenging sensing conditions. AISPO combines multi-scale RGB-D feature fusion with an affine-invariant shape prior to enforce geometric consistency and mitigate catastrophic depth failures. Unlike methods that focus primarily on average depth accuracy, our approach emphasizes physical plausibility and structural integrity of the predicted depth maps. Extensive benchmark evaluations demonstrate competitive performance and strong generalization to unseen objects and novel scenes. Real-world grasping experiments further show that enhanced depth reliability significantly improves manipulation success rates, particularly for transparent objects where many existing methods fail to produce physically usable depth estimates.
CMU ML