Search papers, labs, and topics across Lattice.
This paper introduces ReStruct, a novel approach for inference-time behavior steering in robot policies that allows for real-time redirection based on user preferences without the need for retraining. By decomposing a visuomotor policy into a high-level state-machine skeleton and a low-level continuous controller, ReStruct effectively incorporates user preferences into the task structure while maintaining physical feasibility. Experimental results demonstrate that ReStruct outperforms existing methods, achieving up to 25% higher task success and preference adherence compared to VLA models.
ReStruct enables robots to adaptively steer their behavior in real-time, achieving unprecedented levels of task success and preference alignment without retraining.
A central challenge in deploying learned robot policies is inference-time behavior steering: redirecting a policy at test time to satisfy user preferences not anticipated during training, without retraining. Existing methods fail in two modes: end-to-end methods require fine-tuning or expert-level guidance, while neuro-symbolic methods rely on predefined symbols whose edits can result in logically reasonable but physically infeasible plans. To address this challenge, we propose ReStruct, which builds upon a neural automaton policy that decomposes a visuomotor policy into a high-level state-machine skeleton capturing task structure and a low-level continuous controller represented as a residual policy. Specifically, ReStruct adopts the automaton to represent the preference and incorporates it into the skeleton through a synchronous product, thereby reconfiguring the task structure. With the controller kept frozen, the action priors provided by the skeleton are updated accordingly to enable physically-aware control under a modified task structure. Extensive experiments from simulation and real-world show that ReStruct steers a wide range of preferences, from object-centric specifications to temporal-logic constraints, and after steering surpasses existing methods, exceeding VLA models in both task success and preference-following by up to 25%.
CMU ML