Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to robotic affordance estimation by using two coupled particle filters, one for graspable regions and another for movable regions. The coupling facilitates bidirectional information exchange, focusing attention on regions where both filters agree, thereby disambiguating visual, geometric, and semantic ambiguities. Experiments on a real-world dataset demonstrate that the proposed method significantly outperforms existing affordance estimators, achieving up to 308% higher precision and maintaining robustness in challenging conditions.
Achieve 3x better precision in robotic affordance estimation by coupling particle filters for graspable and movable regions, even in low light and cluttered environments.
Robotic affordance estimation is challenging due to visual, geometric, and semantic ambiguities in sensory input. We propose a method that disambiguates these signals using two coupled recursive estimators for sub-aspects of affordances: graspable and movable regions. Each estimator encodes property-specific regularities to reduce uncertainty, while their coupling enables bidirectional information exchange that focuses attention on regions where both agree, i.e., affordances. Evaluated on a real-world dataset, our method outperforms three recent affordance estimators (Where2Act, Hands-as-Probes, and HRP) by 308%, 245%, and 257% in precision, and remains robust under challenging conditions such as low light or cluttered environments. Furthermore, our method achieves a 70% success rate in our real-world evaluation. These results demonstrate that coupling complementary estimators yields precise, robust, and embodiment-appropriate affordance predictions.
