Search papers, labs, and topics across Lattice.
This paper introduces the Enhanced World Action Model (EWAM), which leverages a pretrained Cosmos3 backbone to enable closed-loop online adaptation without requiring additional task-specific data or fine-tuning. By integrating four lightweight neural layers, EWAM enhances real-time decision-making through co-reasoning mechanisms, including memory, anomaly detection, and action correction. The evaluation demonstrates significant performance improvements in zero-shot tasks, showcasing EWAM's ability to adapt efficiently to new environments with minimal overhead.
EWAM achieves remarkable zero-shot adaptation by integrating real-time co-reasoning mechanisms, eliminating the need for task-specific data or fine-tuning.
In this paper, we propose the Enhanced World Action Model (EWAM), a closed-loop online adaptation architecture built upon a pretrained and fully frozen Cosmos3 backbone network. Evaluated entirely under a zero-shot task protocol, EWAM is centrally focused on reducing the amount of additional deployment data required to adapt to new task layouts. Notably, no extra task-specific demonstration sets were introduced in any of the evaluations, and no fine-tuning was performed on the backbone network. Its performance gains stem entirely from an inference-time co-reasoning mechanism composed of four inserted lightweight neural layers: the Neural Experience Memory Layer located in the intermediate layers of the Diffusion Transformer (DiT) provides task-relevant execution context; the Neural Anomaly Detection Layer after the state prediction head monitors the divergence between predicted and actual states in real time; the Neural Policy Routing Layer dynamically selects direct execution, conservative replanning, or rollback recovery based on the anomaly severity; and the Neural Action Correction Layer refines the generated action chunks using execution diagnostics. Unlike naive feature fusion, the memory, anomaly detection, and correction modules are deeply integrated into the Cosmos3 forward path in a differentiable manner, with only the final routing decision being a discrete supervised one.
