Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
CarryOn augments frozen VLA models with a dual-loop harness to achieve personalized and reliable robotic assistance by explicitly modeling persistent user and scene context for grounded subtask selection and by implementing an execution loop that proactively prevents hazards and recovers from failures using reusable skills. This system addresses the critical limitations of generalist VLAs in real-world applications by enabling preference-consistent task execution across diverse users and environments and significantly enhancing safety and robustness. Experiments on a real robot and in simulation demonstrate CarryOn's effectiveness in reducing safety violations and improving recovery success rates.
A single dual-loop harness enables generalist VLAs to achieve preference-consistent task execution and robust failure recovery in real-world robotics.
While generalist vision-language-action (VLA) models have enabled diverse open-world manipulation, real-world robotic assistance requires two critical capabilities they currently lack: personalization and reliable execution. First, executing an instruction like"make me a sandwich"requires grounding subtask decomposition in persistent user preferences rather than relying on a single generic solution. Second, reliable deployment demands explainable safety assurance that proactively prevents hazards and gracefully recovers from occasional physical failures. To address these gaps, we present CarryOn, a dual-loop harness designed to augment a frozen VLA policy. The planning loop maintains persistent user-level and scene-level context that is continually grounded against new observations and revised through interaction, enabling personalized task selection and execution grounding across conversations and changing scenes. The execution loop actively supervises policy rollouts, shielding actions from predicted hazardous contact. When execution fails, the system invokes reusable control-based recovery skills that restore task progress and are refined through reflection on earlier failures. On a real robot and in simulation, CarryOn dispatches preference-consistent subtasks across users and scenes, reduces the violation rate of an already safety-finetuned VLA from 52.6% to 6.1%, and increases recovery success from 13% to 80% when refined skills are reused.