Search papers, labs, and topics across Lattice.
The paper introduces GraspALL, a novel approach to improve robotic garment grasping accuracy in low-light conditions by adaptively fusing RGB and non-RGB (depth) features. GraspALL encodes continuous illumination changes into quantitative references that guide the feature fusion process, allowing the model to dynamically adjust its reliance on different modalities based on lighting intensity. Experiments on a new garment grasping dataset show that GraspALL achieves a 32-44% improvement in grasping accuracy compared to baseline methods under diverse illumination conditions.
GraspALL achieves 32-44% better garment grasping accuracy in low-light by adaptively fusing RGB and depth data based on a learned illumination intensity reference.
Achieving accurate garment grasping under dynamically changing illumination is crucial for all-day operation of service robots.However, the reduced illumination in low-light scenes severely degrades garment structural features, leading to a significant drop in grasping robustness.Existing methods typically enhance RGB features by exploiting the illumination-invariant properties of non-RGB modalities, yet they overlook the varying dependence on non-RGB features under varying lighting conditions, which can introduce misaligned non-RGB cues and thereby weaken the model's adaptability to illumination changes when utilizing multimodal information.To address this problem, we propose GraspALL, an illumination-structure interactive compensation model.The innovation of GraspALL lies in encoding continuous illumination changes into quantitative references to guide adaptive feature fusion between RGB and non-RGB modalities according to varying lighting intensities, thereby generating illumination-consistent grasping representations.Experiments on the self-built garment grasping dataset demonstrate that GraspALL improves grasping accuracy by 32-44% over baselines under diverse illumination conditions.