Search papers, labs, and topics across Lattice.
This paper investigates zero-shot transfer of a Dreamer-style driving agent between CARLA towns, focusing on structural town shift in a controlled setting. They introduce two auxiliary losses: multi-horizon prediction of visual-semantic embeddings along imagined rollouts conditioned on a causal context feature, and town-adversarial regularization on a semantic projection of the recurrent latent state. Results show that this approach improves mean held-out-town route completion compared to other Dreamer-family methods in fixed-weather conditions.
Semantic rollouts and town-adversarial regularization can significantly boost zero-shot driving performance in unseen CARLA towns, even without explicit navigation commands or map inputs.
Learned driving agents often degrade when deployed in unseen environments. This paper studies a deliberately bounded instance of that problem in the CARLA simulator: zero-shot transfer of a closed-loop fixed-route driving agent from Town05 and Town06 to unseen Town03 and Town04. The study isolates structural town shift by keeping weather fixed to ClearNoon and removing traffic and pedestrians. We build on a Dreamer-style latent world-model agent and add two training-only auxiliary losses: multi-horizon prediction of future visual-semantic embeddings along imagined rollouts and town-adversarial supervision on a semantic projection of the recurrent latent state. A causal context feature conditions the semantic rollout predictor, while the actor and critic retain the standard control feature. The policy receives no navigation command, route polyline, goal pose, or map input; the reference route is used only by the environment for reward, progress, success, and termination. Across the evaluated held-out towns, the proposed model achieves the highest mean success rate among the included Dreamer-family methods. Secondary safety and lane-keeping metrics are mixed across towns. These results support a bounded conclusion: in this controlled fixed-weather CARLA setting, semantic rollout supervision combined with town-adversarial regularization improves mean held-out-town route completion.
