Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
CarryOn augments frozen VLA policies with a dual-loop harness to achieve personalized and reliable robot assistance by explicitly modeling persistent user and scene context for preference-consistent task grounding and employing an execution loop for proactive hazard shielding and robust failure recovery. This system significantly reduces safety violations and enhances task completion success through reusable, refined recovery skills, addressing key limitations of current generalist VLA models in real-world applications. The planning loop continuously updates context against observations and interactions, while the execution loop supervises policy rollouts and invokes recovery skills upon failure.
A single adversarial token can bypass most safety filters.
While generalist vision-language-action (VLA) models have enabled diverse open-world manipulation, real-world robotic assistance requires two critical capabilities they currently lack: personalization and reliable execution. First, executing an instruction like"make me a sandwich"requires grounding subtask decomposition in persistent user preferences rather than relying on a single generic solution. Second, reliable deployment demands explainable safety assurance that proactively prevents hazards and gracefully recovers from occasional physical failures. To address these gaps, we present CarryOn, a dual-loop harness designed to augment a frozen VLA policy. The planning loop maintains persistent user-level and scene-level context that is continually grounded against new observations and revised through interaction, enabling personalized task selection and execution grounding across conversations and changing scenes. The execution loop actively supervises policy rollouts, shielding actions from predicted hazardous contact. When execution fails, the system invokes reusable control-based recovery skills that restore task progress and are refined through reflection on earlier failures. On a real robot and in simulation, CarryOn dispatches preference-consistent subtasks across users and scenes, reduces the violation rate of an already safety-finetuned VLA from 52.6% to 6.1%, and increases recovery success from 13% to 80% when refined skills are reused.