Search papers, labs, and topics across Lattice.
This paper introduces an Adaptive Multi-scale Attention Aggregation (AMAA) framework to improve 3D Semantic Scene Completion (SSC) from monocular vision, focusing on feature reliability and cross-scale information propagation. AMAA calibrates lifted voxel features using parallel channel-spatial attention and stabilizes multi-scale fusion with a hierarchical adaptive feature-gating strategy. Experiments on NYUv2 show that AMAA improves SSC mIoU and SC IoU over MonoScene while maintaining deployability on embedded systems.
Seemingly small architectural tweaks to feature aggregation and fusion can yield surprisingly robust improvements in 3D semantic scene completion, even on resource-constrained hardware.
In indoor assistive perception for visually impaired users, 3D Semantic Scene Completion (SSC) is expected to provide structurally coherent and semantically consistent occupancy under strictly monocular vision for safety-critical scene understanding. However, existing monocular SSC approaches often lack explicit modeling of voxel-feature reliability and regulated cross-scale information propagation during 2D-3D projection and multi-scale fusion, making them vulnerable to projection diffusion and feature entanglement and thus limiting structural stability.To address these challenges, this paper presents an Adaptive Multi-scale Attention Aggregation (AMAA) framework built upon the MonoScene pipeline. Rather than introducing a heavier backbone, AMAA focuses on reliability-oriented feature regulation within a monocular SSC framework. Specifically, lifted voxel features are jointly calibrated in semantic and spatial dimensions through parallel channel-spatial attention aggregation, while multi-scale encoder-decoder fusion is stabilized via a hierarchical adaptive feature-gating strategy that regulates information injection across scales.Experiments on the NYUv2 benchmark demonstrate consistent improvements over MonoScene without significantly increasing system complexity: AMAA achieves 27.25% SSC mIoU (+0.31) and 43.10% SC IoU (+0.59). In addition, system-level deployment on an NVIDIA Jetson platform verifies that the complete AMAA framework can be executed stably on embedded hardware. Overall, AMAA improves monocular SSC quality and provides a reliable and deployable perception framework for indoor assistive systems targeting visually impaired users.
