Search papers, labs, and topics across Lattice.
This study reveals that pretrained Vision-Language-Action (VLA) models inherently encode crucial distinctions between pedestrians and obstacles, as well as signals for potential collisions. However, traditional behavior cloning methods fail to utilize these encoded signals effectively for socially appropriate actions. The proposed SALSA framework, which employs a two-stage post-training approach, significantly enhances safety in social navigation, achieving an 86.4% reduction in near-collisions and boosting social counterfactual accuracy from 53% to 93%.
Pretrained VLA models can be transformed into safer navigators, reducing near-collisions by over 86% through better alignment of their internal representations with action outputs.
Safe social navigation requires robots to distinguish people from ordinary obstacles and to react before danger becomes imminent. We show that pretrained Vision-Language-Action (VLA) models already encode pedestrian-object distinctions and future collision signals in their internal representations, but behavior cloning fails to translate these signals into socially appropriate actions. To address this mismatch, we propose SALSA, a two-stage annotation-free post-training framework: (1) social behavioral alignment bridges intermediate-layer social features to the action head and trains on counterfactual human-object scene pairs to break visual saliency shortcuts; (2) temporal safety alignment provides automatically generated future-risk supervision to enable anticipatory collision avoidance. On SCAND and real-world deployment, SALSA reduces near-collisions by 86.4% and improves social counterfactual accuracy from 53% to 93%, demonstrating that safer social navigation can be achieved by teaching VLA policies to act on representations they already possess. These results show that pretrained VLA policies can be adapted for safer social navigation by better aligning their latent representations with action generation.
