Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The MOTOR dataset is introduced as the first large-scale, multi-view, multimodal dataset for two-wheeler rider behavior understanding in dense, unstructured traffic, comprising over 25 hours of synchronized video, eye-gaze, audio, and telemetry data from 16 riders. The dataset is richly annotated with traffic context, rider state, riding maneuvers, and legality labels. Benchmarking experiments using CNN and Transformer-based video action recognition backbones, extended with multimodal fusion, demonstrate that combining RGB, gaze, and telemetry data yields the best performance for rider behavior recognition and maneuver legality classification.
Understanding two-wheeler rider behavior in unstructured traffic just got a major boost: MOTOR provides the first large-scale multimodal dataset to tackle this critical, yet understudied, area.
Two-wheelers account for a disproportionately high share of road fatalities in the Global South. Research on two-wheeler rider behavior, however, lags far behind four-wheelers, where multimodal datasets have driven major advances in Advanced Driver Assistance Systems (ADAS). To address this gap, we present the MOtorized TwO-wheeler Rider (MOTOR) dataset, the first large-scale, multi-view, multimodal resource dedicated to two-wheelers in dense, unstructured traffic. MOTOR comprises 1,629 sequences (25+ hours of video data) collected from 16 riders and integrates synchronized front, rear, and helmet videos, rider eye-gaze from wearable trackers, on-road audio, and telemetry (GPS, accelerometer, gyroscope). Rich annotations capture traffic context, rider state, 12 riding maneuvers spanning conventional and unconventional behaviors, and legality labels (Legal, Illegal, Unspecified). We benchmark rider behavior recognition and maneuver legality classification using state-of-the-art video action recognition backbones (CNN and Transformer-based), extended with multimodal fusion, and find that combining RGB, gaze, and telemetry consistently yields the best performance. MOTOR thus provides a unique foundation for advancing safety-critical understanding of two-wheeler riding. It offers the research community a benchmark to develop and evaluate models for behavior analysis, legality-aware prediction, and intelligent transportation systems. Dataset and code is available at https: //varuniiith.github.io/MOTOR-Dataset/