Search papers, labs, and topics across Lattice.
This paper introduces a new vision-language-action (VLA) task focused on fine-grained kinematic control, where language commands specify detailed kinematic attributes throughout the action execution. To tackle this, they propose KineVLA, a framework that uses a bi-level action representation and reasoning tokens to decouple goal-level invariance from kinematics-level variability. Experiments on simulated and real-world robotic platforms show KineVLA outperforms existing VLA models in achieving precise, controllable, and generalizable manipulation.
Achieve more precise robot control by explicitly disentangling high-level goals from low-level kinematic instructions.
In this paper, we introduce a novel kinematics-rich vision-language-action (VLA) task, in which language commands densely encode diverse kinematic attributes (such as direction, trajectory, orientation, and relative displacement) from initiation through completion, at key moments, unlike existing action instructions that capture kinematics only coarsely or partially, thereby supporting fine-grained and personalized manipulation. In this setting, where task goals remain invariant while execution trajectories must adapt to instruction-level kinematic specifications. To address this challenge, we propose KineVLA, a vision-language-action framework that explicitly decouples goal-level invariance from kinematics-level variability through a bi-level action representation and bi-level reasoning tokens to serve as explicit, supervised intermediate variables that align language and action. To support this task, we construct the kinematics-aware VLA datasets spanning both simulation and real-world robotic platforms, featuring instruction-level kinematic variations and bi-level annotations. Extensive experiments on LIBERO and a Realman-75 robot demonstrate that KineVLA consistently outperforms strong VLA baselines on kinematics-sensitive benchmarks, achieving more precise, controllable, and generalizable manipulation behaviors.
