Search papers, labs, and topics across Lattice.
This paper introduces Point Ladder Tuning (PLT), a parameter-efficient framework for fine-tuning 3D point cloud models that preserves fine-grained local geometry while keeping the backbone frozen. By employing a Hierarchical Ladder Network for multi-resolution feature extraction and a Local-Global Fusion mechanism to integrate local and global features, PLT achieves significant improvements in classification and dense prediction tasks. The results demonstrate that PLT outperforms existing methods with only 2.71% and 7.69% of trainable parameters for classification and dense prediction, respectively, showcasing its efficiency and effectiveness.
PLT achieves state-of-the-art performance in 3D point cloud understanding while using less than 8% of the parameters typically required for fine-tuning.
Fine-tuning pre-trained point-cloud backbones typically updates all parameters, resulting in substantial computation and memory overhead. More importantly, modern point backbones rely on aggressive tokenization and downsampling, which yields compact global tokens but irreversibly discards fine-grained local geometry, an inherent bottleneck for parameter-efficient adaptation. Consequently, existing PEFT methods that operate only on these coarsened tokens can modulate global semantics but struggle to recover the missing multi-scale locality. We present Point Ladder Tuning (PLT), a locality-aware PEFT framework that performs hierarchical, instance-conditioned adaptation while keeping the backbone frozen. PLT forms a lightweight closed loop: (i) a Hierarchical Ladder Network (HLN) constructs a multi-resolution local feature pyramid directly from raw points; (ii) a Local-Global Fusion (LGF) aligns and fuses local pyramids with intermediate backbone semantics; and (iii) a Dynamic Prompt Generator produces instance-aware multi-scale prompts to modulate the frozen backbone effectively. For dense prediction, we further introduce a lightweight segmentation head that progressively upsamples fused features and leverages backbone priors to refine fine structures. Extensive experiments on classification and dense prediction show that PLT consistently surpasses prior PEFT baselines with minimal tunable parameters. PLT achieves state-of-the-art performance using only 2.71% trainable parameters for classification and 7.69% for dense prediction, and scales favorably to larger backbones, requiring merely 0.36% parameters on PointGPT-L. The code is released at https://github.com/JunLinChang/ECCV2026-PLT.
