Search papers, labs, and topics across Lattice.
This paper introduces InDex, a novel framework that adapts Vision-Language-Action (VLA) models for dexterous manipulation by leveraging cross-morphology semantic inheritance to overcome the limitations of traditional fine-tuning methods. By employing a two-stage decoupled learning architecture, InDex first aligns the VLA backbone to predict continuous arm trajectories and grasp intent, then utilizes a denoising diffusion head to decode joint articulations for multi-fingered hands. The results show that InDex achieves superior performance in complex manipulation tasks with minimal demonstration data, while maintaining the spatial reasoning capabilities of the original VLA model.
InDex bridges the morphology gap, enabling VLA models to excel in dexterous manipulation with minimal data while preserving spatial reasoning.
Vision-Language-Action (VLA) models have demonstrated remarkable zero-shot generalization in robotic manipulation, yet the vast majority of pre-trained pipelines remain strictly confined to low-DoF parallel grippers. Adapting these rich semantic priors to high-DoF dexterous hands introduces a severe morphology gap, direct end-to-end joint fine-tuning inherently causes catastrophic forgetting of spatial reasoning and acute action manifold collapse due to data scarcity. In this paper, we present InDex, a novel, data-efficient adaptation framework rooted in cross-morphology semantic inheritance. Rather than discarding the pre-trained 1-DoF parallel grasp output, we repurpose it as a continuous, macroscopic virtual grasp intent proxy to sequentialize the control topology. We implement a two-stage decoupled learning architecture: the first stage parameter-efficiently aligns the VLA backbone to predict continuous arm trajectories and the scalar grasp intent; the second stage freezes this spatial backbone and leverages an intent-conditioned denoising diffusion head to decode fine-grained joint articulations for multi-fingered end-effectors. Extensive simulation benchmarks across a suite of multi-stage, contact-rich dexterous manipulation tasks demonstrate that InDex effectively masters intricate skills with minimal demonstration data, substantially outperforming monolithic baselines while preserving the robust spatial generalizability of the original VLA prior.
