Search papers, labs, and topics across Lattice.
PRTS, a Vision-Language-Action model, reframes pretraining as goal-conditioned RL by treating language instructions as goals and employing contrastive RL to learn a unified embedding space. This space approximates the log-discounted goal occupancy using the inner product of state-action and goal embeddings, enabling the model to assess physical feasibility. PRTS, pretrained on 167B tokens, achieves state-of-the-art performance on multiple benchmarks, demonstrating significant gains in long-horizon, contact-rich, and zero-shot novel-instruction settings.
By learning to predict goal reachability directly from offline trajectories, PRTS enables robots to reason about task progress and physical feasibility, leading to substantial improvements in long-horizon planning and zero-shot generalization.
Vision-Language-Action (VLA) models advance robotic control via strong visual-linguistic priors. However, existing VLAs predominantly frame pretraining as supervised behavior cloning, overlooking the fundamental nature of robot learning as a goal-reaching process that requires understanding temporal task progress. We present \textbf{PRTS} (\textbf{P}rimitive \textbf{R}easoning and \textbf{T}asking \textbf{S}ystem), a VLA foundation model that reformulates pretraining through Goal-Conditioned Reinforcement Learning. By treating language instructions as goals and employing contrastive reinforcement learning, PRTS learns a unified embedding space where the inner product of state-action and goal embeddings approximates the log-discounted goal occupancy, the probability of reaching the language-specified goal from the current state-action, quantitatively assessing physical feasibility beyond static semantic matching. PRTS draws this dense goal-reachability supervision directly from offline trajectories without reward annotations, and folds it into the VLM backbone via a role-aware causal mask, incurring negligible overhead over vanilla behavior cloning. This paradigm endows the high-level reasoning system with intrinsic goal reachability awareness, bridging semantic reasoning and temporal task progress, and further benefits goal-conditioned action prediction. Pretrained on 167B tokens of diverse manipulation and embodied-reasoning data, PRTS reaches state-of-the-art performance on LIBERO, LIBERO-Pro, LIBERO-Plus, SimplerEnv, and a real-world suite of 14 complex tasks, with particularly substantial gains on long-horizon, contact-rich, and zero-shot novel-instruction settings, confirming that injecting goal-reachability awareness significantly improves both execution success and long-horizon planning of general-purpose robotic foundation policies.
Tsinghua AI