Search papers, labs, and topics across Lattice.
Addressing the limitation of clip-level video benchmarks that fail to capture actions online, the authors construct SAFER-Activities, a 66-hour multi-camera dataset comprising 85,310 frame-level annotated instances across 30 action classes, including a specialized wheelchair-use subset. Frame-level temporal granularity is critical for evaluating real-time, low-latency intervention models in safety-critical eldercare and assistive settings. Benchmarks across 2D/3D skeleton, frozen RGB, and fused architectures show that while multimodal fusion maximizes in-domain accuracy鈥攑articularly for wheelchair events鈥攑ure skeleton-based representations exhibit significantly stronger generalization under out-of-distribution and cross-dataset distribution shifts.
Multimodal RGB-pose fusion maximizes in-domain fall detection accuracy, but skeletal representations alone are what survive out-of-distribution shifts to unseen environments.
Smart healthcare monitoring systems require precise action recognition to ensure well-being and timely intervention in critical situations such as falls, particularly for mobility-challenged individuals. Existing datasets are often clip-based, lacking the frame-level detail needed to recognize actions online, as they unfold. To address this, we introduce SAFER-Activities, a dataset for fall detection and physical activity monitoring, with a dedicated subset for wheelchair use scenarios. It comprises over 66 hours of video data captured by multiple cameras, with 85,310 action instances and frame-level annotations for 30 action classes. We benchmark action recognition on SAFER-Activities with 2D and 3D skeleton models, RGB models with frozen backbones, and multimodal fusion strategies, and evaluate on in-lab, out-of-distribution, and cross-dataset test sets. Skeleton-based models generalize best under domain shift; fusing frozen RGB features with the skeleton stream improves in-domain recognition over the baseline CNN1D, most clearly on the wheelchair subset, but degrades out of distribution. Cross-dataset and qualitative evaluations confirm that models trained on SAFER-Activities transfer well to unseen environments and external fall data. To support research on robust fall detection and activity monitoring, we release the dataset and code at https://safer-activities.github.io/.
