Search papers, labs, and topics across Lattice.
This paper introduces ROBOSHACKLES, a novel safety dataset designed to enhance human-injury prevention in Embodied Foundation Models (EFMs) by simulating hazardous scenarios. The dataset is constructed through a comprehensive pipeline that includes scene understanding, hazard-aware image editing, and temporal prompt generation, resulting in 10,000 clips that cover various direct and indirect harm categories. Evaluation reveals that all tested EFMs generate unsafe actions in critical scenarios, highlighting the urgent need for improved safety mechanisms in robotic systems.
All evaluated EFMs produced unsafe actions in safety-critical scenarios, underscoring a critical gap in current safety alignment for robotic systems.
Embodied Foundation Models (EFMs) integrate multimodal understanding, future-state reasoning, and executable robot actions. Yet their safety alignment for human-injury prevention remains underexplored, primarily because real-world data of robots harming humans or creating hazardous household situations cannot be safely or ethically collected. To address this challenge, we propose a safety-critical data construction pipeline for human-injury prevention in EFMs.Starting from real DROID observations, our construction pipeline proceeds through scene understanding, hazard-aware image editing, temporal prompt generation, and single-pass rollout synthesis. The temporal prompts specify the expected scene evolution, while Wan2.7 synthesizes realistic robotic rollouts from the edited hazardous states in a single pass. Using this pipeline, we construct ROBOSHACKLES, a 10,000-clip robotic video dataset derived from real DROID observations, spanning two direct-harm and four indirect-harm categories. To ensure dataset quality, we assess task completion and visual quality with automatic metrics, and evaluate six representative EFMs under a refusal-based safety criterion. Results show that all evaluated models produce unsafe actions in the tested safety-critical scenarios, yielding a 100% unsafe action generation rate. ROBOSHACKLES serves as a scalable benchmark and training resource for refusal learning and hazard anticipation before robot action execution.The dataset is publicly available at https://huggingface.co/datasets/YZW00/RoboShackles.
