Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces MAMVI, a novel approach to 3D test-time adaptation that enhances performance under distribution shifts by employing a unified single-step adaptation method instead of traditional sequential optimization. By integrating a hybrid masking strategy and a confidence-based adaptive learning rate, MAMVI aggregates losses across multiple views to achieve significant improvements in accuracy while drastically reducing inference latency. Experimental results on benchmark datasets show that MAMVI not only achieves state-of-the-art accuracy on ShapeNet-C and ScanObjectNN-C but also provides 4.9-8.9 times faster inference compared to existing methods.
MAMVI achieves state-of-the-art accuracy in 3D point cloud adaptation while slashing inference times by up to 8.9 times.
3D point cloud models suffer significant performance degradation under distribution shifts caused by sensor noise, occlusions, and environmental changes. Test-time adaptation (TTA) has emerged as a practical paradigm for mitigating this issue during inference. Recently, leveraging multi-view augmentation has shown promise in improving 3D TTA performance. However, existing multi-view approaches are often constrained by sequential optimization that treats each view independently. This sequential optimization leads to substantial inference latency due to repetitive optimization steps, making real-time adaptation impractical. To address this, we propose Masked Multi-View Test-Time Adaptation (MAMVI), which replaces sequential optimization with a unified single-step adaptation. Specifically, MAMVI utilizes a hybrid masking strategy that combines fixed ratios for stability with Beta-distributed sampling for diversity. By aggregating losses across multiple views, MAMVI performs adaptation through a single backward pass based on multi-view consensus. Additionally, a confidence-based adaptive learning rate is used to dynamically adjust the adaptation intensity for each sample. Extensive experiments on ModelNet-40C, ShapeNet-C, and ScanObjectNN-C demonstrate that MAMVI achieves state-of-the-art accuracy on ShapeNet-C and ScanObjectNN-C. Moreover, it remains competitive on ModelNet-40C while delivering 4.9-8.9 times faster inference, making it highly suitable for real-time applications. Our code is available at https://github.com/Inseok-kong/MAMVI