Search papers, labs, and topics across Lattice.
This paper introduces a multi-view tensor decomposition framework to analyze driver behavior at railway crossings by representing video data with TimeSformer embeddings and decomposing phase-specific similarity matrices. The method uses non-negative symmetric CP decomposition to extract latent behavioral components across three temporal phases: Approach, Waiting, and Clearance. Results indicate that crossing location is a stronger determinant of behavior than time of day, and that approach-phase behavior is particularly discriminative, enabling location-based clustering for targeted safety interventions.
Forget analyzing railway crossings individually – tensor decomposition reveals distinct behavioral signatures tied to location, enabling targeted safety interventions.
Railway crossings present complex safety challenges where driver behavior varies by location, time, and conditions. Traditional approaches analyze crossings individually, limiting the ability to identify shared behavioral patterns across locations. We propose a multi-view tensor decomposition framework that captures behavioral similarities across three temporal phases: Approach (warning activation to gate lowering), Waiting (gates down to train passage), and Clearance (train passage to gate raising). We analyze railway crossing videos from multiple locations using TimeSformer embeddings to represent each phase. By constructing phase-specific similarity matrices and applying non-negative symmetric CP decomposition, we discover latent behavioral components with distinct temporal signatures. Our tensor analysis reveals that crossing location appears to be a stronger determinant of behavior patterns than time of day, and that approach-phase behavior provides particularly discriminative signatures. Visualization of the learned component space confirms location-based clustering, with certain crossings forming distinct behavioral clusters. This automated framework enables scalable pattern discovery across multiple crossings, providing a foundation for grouping locations by behavioral similarity to inform targeted safety interventions.
