Search papers, labs, and topics across Lattice.
PlaneCycle is introduced as a training-free and adapter-free operator for lifting 2D foundation models to 3D by cyclically distributing spatial aggregation across orthogonal planes (HW, DW, DH) within the network. This approach reuses the pretrained 2D backbone and introduces no additional parameters, enabling progressive 3D fusion. Experiments using pretrained DINOv3 models show that PlaneCycle, even without training, outperforms slice-wise 2D baselines and strong 3D counterparts on 3D classification and segmentation tasks, and matches standard 3D architectures after fine-tuning.
Unlock surprisingly strong 3D performance from your 2D foundation models without any training or architectural changes using a clever cyclical aggregation strategy.
Large-scale 2D foundation models exhibit strong transferable representations, yet extending them to 3D volumetric data typically requires retraining, adapters, or architectural redesign. We introduce PlaneCycle, a training-free, adapter-free operator for architecture-agnostic 2D-to-3D lifting of foundation models. PlaneCycle reuses the original pretrained 2D backbone by cyclically distributing spatial aggregation across orthogonal HW, DW, and DH planes throughout network depth, enabling progressive 3D fusion while preserving pretrained inductive biases. The method introduces no additional parameters and is applicable to arbitrary 2D networks. Using pretrained DINOv3 models, we evaluate PlaneCycle on six 3D classification and three 3D segmentation benchmarks. Without any training, the lifted models exhibit intrinsic 3D fusion capability and, under linear probing, outperform slice-wise 2D baselines and strong 3D counterparts, approaching the performance of fully trained models. With full fine-tuning, PlaneCycle matches standard 3D architectures, highlighting its potential as a seamless and practical 2D-to-3D lifting operator. These results demonstrate that 3D capability can be unlocked from pretrained 2D foundation models without structural modification or retraining. Code is available at https://github.com/HINTLab/PlaneCycle.
