Search papers, labs, and topics across Lattice.
HiPHI is a novel 600+ hour dataset that captures high-fidelity whole-body human motion and object interactions, addressing the limitations of existing embodied datasets that either lack precise physical states or have narrow behavioral coverage. By leveraging an optical motion capture pipeline and grounding the dataset in the FrameNet linguistic framework, HiPHI maximizes the diversity of human motion and interaction scenarios. The benchmark suite accompanying HiPHI demonstrates its superiority in motion-space diversity and interaction quality, providing a robust foundation for training humanoid policies in real-world applications.
HiPHI significantly expands the diversity of human motion data, offering a game-changing resource for training humanoid AI in complex real-world tasks.
Humanoid intelligence requires learning over an extremely diverse space of whole-body motions and physically grounded interactions. However, existing embodied datasets remain fundamentally limited: internet-scale video data lack precise physical states and interaction grounding, while laboratory motion datasets provide high fidelity but only narrow behavioral coverage. This mismatch creates a critical bottleneck for scalable humanoid policy learning. We present HiPHI, a 600+ hour scale high-fidelity whole-body human motion dataset designed to systematically maximize coverage of the human motion and interaction manifold. HiPHI is theoretically guided by FrameNet, a linguistic framework organizing human primitives. Created using an optical motion capture pipeline, HiPHI provides sub-millimeter spatial marker tracking accuracy for full-body human motion and mesh-level object trajectories. We further introduce a benchmark suite evaluating motion-space diversity, interaction grounding, object consistency, and physical AI applications. Our analyses demonstrate that HiPHI significantly expands motion coverage compared to existing motion datasets while maintaining high-fidelity interaction quality, and establishes a scalable data foundation for training, evaluating, and generalizing humanoid policies in real-world embodied tasks, where similar extensions are also applicable to motion prior models in computer graphics.
