Search papers, labs, and topics across Lattice.
This paper addresses the challenge of reachability analysis in visuomotor policies by freezing the visual encoder and applying set propagation to a low-dimensional interface, optimizing it through set-based training. The approach effectively reduces the probabilistic reachable-action radius while maintaining task performance, demonstrating a significant improvement over traditional methods that rely on larger, more conservative models. Experimental results indicate that this method not only enhances efficiency but also preserves the closed-loop capabilities of the policy in controlled manipulation tasks.
Set-based training can shrink the reachable-action radius of visuomotor policies without sacrificing performance, outperforming traditional methods by a significant margin.
Reachability analysis for visuomotor policies is difficult because large visual encoders make end-to-end set propagation computationally expensive and excessively conservative. We therefore freeze the visual encoder and confine set propagation to a low-dimensional interface between it and the downstream policy, with the interface set calibrated from held-out camera-pose perturbations. Propagating this set through the policy with zonotopes yields a terminal output-enclosure width that set-based training optimizes directly. During evaluation, camera-pose perturbations are sampled from the prescribed distribution, and rollout-level split conformal calibration converts the resulting action-deviation scores into a probabilistic reachable-action radius with finite-sample coverage. In controlled manipulation experiments, set-based training reduces this radius while preserving closed-loop task capability, and matched behavior-only, observational-consistency, and pointwise-adversarial controls all leave a larger radius.
