Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a unified framework for Floor Affordance (FloAff) prediction that enhances mobile manipulation by addressing representation ambiguity and knowledge entanglement in spatial reasoning. The authors develop a Canonical Floor Affordance Representation (CFAR) to maintain relevant local structures while discarding irrelevant spatial variations, and a Progressive Floor Affordance Learning (PFAL) approach to adapt learned affordance priors across diverse manipulation tasks. Extensive evaluations on the newly established FloAff-Kitchen benchmark show that their method significantly outperforms existing baselines, validating the effectiveness of both CFAR and PFAL components.
A novel framework for Floor Affordance prediction that not only improves manipulation success but also adapts knowledge across diverse tasks, outperforming existing methods.
Mobile manipulation requires robots to identify Floor Affordance (FloAff) that maximizes downstream manipulation success rather than merely ensuring navigation feasibility. FloAff prediction is a target-conditioned local spatial reasoning problem, yet existing methods suffer from representation ambiguity caused by irrelevant spatial context and arbitrary object orientations, while entangling shared and task-specific knowledge across heterogeneous manipulation skills. To address these challenges, we propose a unified framework for FloAff prediction from egocentric multimodal perception, consisting of canonical representation learning and progressive affordance prior learning. Specifically, we introduce a Canonical Floor Affordance Representation (CFAR), which learns canonical interaction geometry by preserving affordance-relevant local structure while eliminating nuisance spatial variations unrelated to robot base placement. We further propose Progressive Floor Affordance Learning (PFAL), which learns transferable FloAff priors from a foundation manipulation task and progressively adapts them to heterogeneous downstream manipulation skills. To facilitate systematic evaluation, we establish the first cross-scene, multi-view FloAff-Kitchen benchmark covering diverse manipulation skills, scene layouts, furniture styles, and viewpoints. Extensive experiments on three benchmark settings demonstrate that our method consistently outperforms strong baselines, while ablation studies validate the contribution of each proposed component. Project page: https://csu-hero-lab.github.io/FloAff-Kitchen_Web/