Search papers, labs, and topics across Lattice.
This paper introduces VISTA-DZ, a novel framework that leverages visual semantic representations of driver trajectories to enhance personalized prediction of stop-go decisions and timing in dilemma zones at signalized intersections. By conditioning a dual-output prediction network on driver-specific behavioral profiles derived from historical data, VISTA-DZ significantly improves prediction accuracy compared to traditional trajectory-only and handcrafted models. The results demonstrate a remarkable 93.26% accuracy in-domain and effective zero-shot transfer capabilities, indicating its potential for real-world applications in adaptive traffic control and driver assistance systems.
Personalized predictions of driver behavior in dilemma zones can achieve over 93% accuracy by harnessing visual semantics and driver profiles.
Driver decision making in the dilemma zone at signalized intersections is safety critical, as vehicles approaching a yellow signal must decide whether to stop or proceed within limited time and distance margins. Accurate prediction of both stop-go decisions and decision timing is important for adaptive signal control, advanced driver assistance systems, and human-centered intelligent transportation applications. However, dilemma zone behavior is strongly driver dependent. Similar approach trajectories may lead to different decisions across drivers because of differences in risk preference, braking habit, and decision threshold. Existing personalized models often rely on handcrafted scalar descriptors, which provide useful but limited summaries of individual behavior. This paper proposes VISTA-DZ, a semantic-profile-conditioned framework for personalized stop-go and decision-time prediction. Historical trajectories are converted into visual representations, interpreted by a vision-language model to generate behavioral profiles, and encoded as semantic embeddings to condition a dual-output prediction network. The final model combines a bidirectional GRU encoder, driver-conditioned multi-head cross-attention, and Feature-wise Linear Modulation for temporal evidence selection and feature adaptation. Experiments on the SDZ dataset and a newly collected FDZ dataset show that VISTA-DZ outperforms trajectory-only and handcrafted personalization baselines, achieving 93.26% in-domain simulation accuracy and 90.22% mean accuracy across 20 held-out simulation drivers. Cross-domain results further show feasible zero-shot simulation-to-real transfer and better real-world generalization when simulation data are combined with limited field data.
