Search papers, labs, and topics across Lattice.
The authors construct DriveMotion, a 393-hour benchmark tracking 133-keypoint continuous poses across 360 drivers at 10 Hz to evaluate fine-grained in-cabin driver motion forecasting. To overcome the static bias of naturalistic driving that causes persistence baselines to dominate, the benchmark establishes a dynamics-anchored evaluation protocol focused on pre-maneuver windows where arm movements surge by 3.4x. On these anchored segments, learned forecasting models reduce prediction error over persistence by 15%, with multi-source pretraining driving a 38% error reduction on held-out drivers.
Standard motion benchmarks fail inside the cabin because drivers mostly sit still鈥攗ntil right before a maneuver, when arm movement spikes 3.4x.
Driver motion can provide cues to ongoing behavior, attention, and near-term driving intent. However, most existing driver-centric datasets focus on recognizing predefined driver behaviors from short video clips, while human motion forecasting benchmarks largely target motion outside the vehicle. We introduce DriveMotion, a multi-source benchmark for continuous driver motion forecasting. DriveMotion contains 393 hours of 133-keypoint motion sequences at 10 Hz from 360 drivers, integrating naturalistic driving data, curated public in-cabin videos, and the AIDE dataset into a unified representation with per-joint validity masks and synchronized driving context. Naturalistic driving contains long periods of limited body movement, making uniformly sampled evaluation dominated by persistence and less sensitive to brief but behaviorally meaningful motion. To address this, we use dynamics-anchored evaluation, placing forecasting windows around vehicle maneuvers identified offline from CAN signals without providing CAN to the model at inference. Arm motion in pre-maneuver windows is 3.4x greater than in route-matched stable-driving controls. On these anchored windows, learned models reduce forecasting error over persistence by up to 15%, while maneuver-enriched training improves forecast-derived Part-State F1 by 44% over the zero-motion reference. Training on the full multi-source corpus further reduces forecasting error on held-out web drivers by 38% compared with BATON-only training. DriveMotion provides identity-disjoint splits, fixed evaluation subsets, and reference implementations for reproducible evaluation of continuous driver motion forecasting. The dataset and benchmark are available at https://huggingface.co/datasets/HenryYHW/DriveMotion
Stanford HAI