Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
Standard continuous action representations force Vision-Language-Action (VLA) policies to execute irreversible actions even under severe epistemic ambiguity, such as heavy visual occlusion during robotic harvesting. To address this, the authors develop Rejectable and Calibrated Decision Heads (RCDH), a structured output interface that attaches to frozen VLA backbones without retraining to enable risk-aware abstention. Across real-world harvesting trials with controlled occlusion, RCDH restores out-of-distribution reliability by safely rejecting ambiguous states while maintaining full in-distribution cutting performance.
Scaling up robot policies cannot prevent catastrophic physical failures under visual occlusion if the model lacks the basic output interface to say "no."
Vision-Language-Action (VLA) policies trained with behavior cloning or flow matching are optimized to output an action trajectory, but they cannot express "I don't know" or "I should not act." In robotic harvesting, occlusion makes single-frame decisions fundamentally ambiguous: identical pixels can correspond either to a cuttable stem or to no stem at all. Existing VLAs are forced to commit, leading to high-confidence errors with irreversible consequences. We argue that the failure mode of a VLA is determined not by backbone scale but by its output interface. We propose Rejectable and Calibrated Decision Heads (RCDH), a typed, rejectable, and calibrated output interface that can be attached to a frozen VLA backbone without retraining or new features. RCDH introduces (i) a decision schema with explicit rejection and ordered, conditional decomposition, and (ii) a calibration procedure for risk-aware abstention. We evaluate RCDH on a robotic harvesting platform with controllable leaf occlusion, comparing generative, enumerated, calibrated, and rejectable interfaces. We show that replacing only the output head restores out-of-distribution usability under occlusion while preserving in-distribution performance. We further test whether the ordering of the rejection space is critical. Our results suggest that the right to refuse, rather than a larger model, is the missing interface for reliable manipulation under uncertainty.