Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
To bridge the dimensional mismatch between 2D foundation models and volumetric brain sMRI without costly per-slice feature aggregation or full 3D pretraining, the authors develop Multiscale Volumetric Reduction (MVR), a gradient-free "reduce-then-encode" framework. The approach compresses through-plane volume depth into a small set of complementary 2D components using uncentered PCA coupled with multiscale residual spatial descriptors estimated strictly from unlabeled training volumes. Evaluated across ADNI, OASIS, and ABIDE with frozen 2D encoders, MVR outperforms conventional slice-aggregation methods under linear probing while retaining robust out-of-distribution generalization to the AIBL cohort.
2D foundation models can dominate 3D medical imaging tasks without the massive inference overhead of per-slice encoding simply by compressing volume depth via gradient-free multiscale PCA before feature extraction.
Pretrained 2D foundation models offer a practical alternative to dedicated 3D pretraining for brain structural magnetic resonance imaging (sMRI), but their use on volumetric data requires bridging the mismatch between a 2D encoder and a 3D volume input. Existing methods typically encode slices independently and integrate their features afterwards. We introduce Multiscale Volumetric Reduction (MVR), a reduce-then-encode approach that compresses each anatomical view from (D) slices into (M << D) complementary 2D components before foundation-model encoding. MVR combines an uncentered-PCA base component derived from the original through-plane intensities with residual detail components constructed from multiscale spatial descriptors. The reduction is estimated from the training volumes without diagnostic labels or gradient-based optimization and remains fixed thereafter. The resulting components are independently processed by a shared frozen 2D foundation model and concatenated for linear probing. Under this frozen-encoder setting, MVR achieves strong overall performance across ADNI, OASIS, and ABIDE relative to the evaluated 2D-to-3D adaptation methods and simple input-reduction baselines, while also generalizing strongly from ADNI to AIBL.