Search papers, labs, and topics across Lattice.
This paper investigates whether frozen vision-language-action (VLA) policies, trained via imitation learning without explicit reward signals, encode information about task success. By training linear probes on frozen features from models like OpenVLA, Pi0.5, DINOv2, and CLIP to predict Monte-Carlo outcome targets, the authors demonstrate that these models implicitly learn value-like representations. Using these probes as test-time selectors over sampled action prefixes improves success rates on manipulation tasks, suggesting a method for improving VLA performance without retraining.
VLAs learn to predict task success even when trained only with imitation learning, opening the door to improved performance without expensive reward engineering.
Vision--language--action (VLA) policies are trained to imitate actions; their loss never asks them to estimate reward, progress, or future success. Their frozen representations nevertheless carry such information, and it can be read out and used to guide action choice without retraining the policy. From mixed successful and failed manipulation trajectories on LIBERO-Goal, we recover Monte-Carlo outcome targets using lightweight linear probes on frozen features. The targets are consistently predictable from OpenVLA, Pi0.5, DINOv2, and CLIP features, and substantially less so from baselines built on progress, time-to-go, task identity, or proprioception. To rule out task and temporal shortcuts, we evaluate the probes under same-task, same-timestep matched comparisons: Pi0.5 probes still reach roughly 92% pairwise ordering accuracy, while label-shuffled controls stay at chance. Used as a test-time selector over sampled Pi0.5 action prefixes, the same probe turns this offline finding into behavior: on push-plate, success rises from 26.7% under greedy decoding to 44.3%, with a second positive case on wine-rack. The gains are not universal and require additional inference compute, but the underlying finding is clean: frozen VLAs already encode information about success that their imitation objective never explicitly demands.
