Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to robotic affordance estimation by using two coupled particle filters, one for graspable regions and another for movable regions. The coupling enables bidirectional information exchange, focusing attention on regions where both estimators agree, thereby disambiguating visual, geometric, and semantic ambiguities. Experiments on a real-world dataset demonstrate that the proposed method significantly outperforms existing affordance estimators, achieving up to 308% higher precision and a 70% success rate in real-world evaluations.
By coupling particle filters for graspability and movability, robots can now estimate affordances with up to 308% better precision, even in challenging lighting and cluttered environments.
Robotic affordance estimation is challenging due to visual, geometric, and semantic ambiguities in sensory input. We propose a method that disambiguates these signals using two coupled recursive estimators for sub-aspects of affordances: graspable and movable regions. Each estimator encodes property-specific regularities to reduce uncertainty, while their coupling enables bidirectional information exchange that focuses attention on regions where both agree, i.e., affordances. Evaluated on a real-world dataset, our method outperforms three recent affordance estimators (Where2Act, Hands-as-Probes, and HRP) by 308%, 245%, and 257% in precision, and remains robust under challenging conditions such as low light or cluttered environments. Furthermore, our method achieves a 70% success rate in our real-world evaluation. These results demonstrate that coupling complementary estimators yields precise, robust, and embodiment-appropriate affordance predictions.