Search papers, labs, and topics across Lattice.
This paper introduces MoRE (Mode Redirection), a novel approach that distills the redirection of behavior modes into policy weights, enabling policies to suppress unsafe or undesired behaviors without the need for inference-time steering. By utilizing a temporary mode classifier and a retain loss to balance behavior editing, MoRE achieves a significant improvement in deployment success rates, outperforming traditional adaptation methods and approaching the performance of filtered-data retraining. The method demonstrates robust generalization across various robot policy architectures and real-world tasks, enhancing both safety and efficiency in policy deployment.
MoRE achieves a staggering 44 percentage point increase in deployment success rates by seamlessly integrating behavior mode redirection into policy weights, eliminating the need for inference-time adjustments.
Behavior-cloned policies often learn multiple behavior modes from demonstration datasets, including modes that are unsafe or otherwise undesired at deployment. For example, a policy trained on diverse handover demonstrations may learn to pass a knife blade-first. Standard remedies such as data curation and inference-time steering either require access to the original demonstrations for full retraining or add substantial inference-time overhead. To address this gap, we propose MoRE(Mode Redirection), which redirects policy rollouts toward desired behavior modes through a short "uncloning" step. Specifically, MoRE distills the redirection signal from a temporary mode classifier into the policy weights to steer behavior. A retain loss balances this edit by preserving desired-mode competence, allowing the standalone policy to suppress unwanted modes with zero inference-time overhead. Across eight simulated and real-world tasks, MoRE improves the average deployment success rate (SR) by 44 percentage points over the original mixed-mode policy. Among all compared adaptation and steering baselines, MoRE achieves the strongest SR and approaches the filtered-data retraining reference, while preserving task competence and inference speed. MoRE also generalizes across robot policy backbones, including Diffusion Policy and the Pi0.5 VLA, diverse task categories, and real-world deployments.
Stanford HAI