Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces SG-AMP, a novel framework that combines depth completion with uncertainty estimation, persistent mapping, and scene-graph reasoning to enhance active perception and motion planning for pepper plants. This approach not only inspects uncertain regions but also predicts unobserved plant structures, optimizing sensor placement based on expected information gain and motion costs tailored to different plant components. Experimental results show significant improvements in semantic segmentation and depth accuracy, highlighting the effectiveness of input-conditioned uncertainty in enhancing perception metrics.
By effectively predicting unobserved plant structures, SG-AMP enhances active perception and motion planning, achieving notable improvements in semantic accuracy and depth estimation.
We present SG-AMP, integrating robust depth completion with input-conditioned uncertainty, persistent panoptic mapping, plant scene-graph reasoning, and semantics-aware active view-motion planning. Beyond inspecting uncertain observed regions, the scene graph explicitly hypothesizes unobserved pepper--peduncle attachments and directs close-range sensing toward them. Candidate views are selected according to expected information gain, while class-dependent motion costs distinguish protected peppers, peduncles, and stems from conditionally traversable foliage. On pepper data, the perception network achieves $55.27\%$ semantic mIoU, $38.67\%$ PQ, and $40.62\,\mathrm{mm}$ depth RMSE, while input-conditioned uncertainty improves NYUv2 NLL from $-1.6518$ to $-1.6925$ and AUSE from $0.0102$ to $0.0087$.