Track trials, findings, and clinical evidence as it lands.
Search papers, labs, and topics across Lattice.
Spark-0 addresses the limitations of vision-only pretraining for dexterous manipulation by integrating tactile sensing through a spatially aligned vision-tactile-language-action (VTLA) model. The model leverages tactile-derived contact maps and 3D geometry features for pretraining supervision, alongside a dedicated tactile pathway for action conditioning during inference. Pretraining on the 1,000-hour HumanTouch dataset significantly boosts performance on both vision-only and tactile-conditioned dexterous manipulation tasks, demonstrating touch's dual role as both a supervisory signal and an operational input.
1,000 hours of human touch data unlocks a 37% jump in vision-only dexterous manipulation success, revealing touch as a powerful pretraining signal beyond its direct use in policies.
Generalist robot policies benefit from large-scale visual pretraining but often struggle with contact-rich dexterous manipulation, where force, compliance, and incipient slip are hard to observe from images. We present Spark-0, a spatially aligned vision-tactile-language-action (VTLA) model that uses touch in two complementary ways. During pretraining, image-space contact maps derived from tactile gloves, together with features from a frozen 3D geometry teacher, supervise the visual tokens; these objectives are removed at inference. In parallel, a tactile pathway encodes regional force histories and 3D taxel states to condition the action expert. A single checkpoint therefore supports both vision-only and tactile-conditioned deployment. To scale this supervision, we build HumanTouch, a 1,000-hour dataset of full-hand tactile human manipulation, and pretrain Spark-0 on it together with egocentric video, robot data, and simulation. We also release SparkArena, which pairs vision-only simulated tasks with tactile-conditioned real-robot tasks on one dexterous embodiment. Spark-0 achieves the highest mean success rate on both SparkArena tracks and ranks first on all eight aggregate metrics of the Ego Humanoid Manipulation Benchmark. Compared with vision-only pretraining on the same data and compute with touch discarded, retaining the touch of 1,000 hours of HumanTouch raises vision-only success on Ego Humanoid from 52.5% to 71.7%, and success on SparkArena-Real, where touch is also used at deployment, from 44.0% to 52.0%, indicating that touch serves not only as a policy input but also as scalable supervision for dexterous visuomotor pretraining. The Website is available at: https://xsparkai.com/Spark-0.