Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a data-centric method for extracting structured task knowledge from expert demonstrations in assembly and disassembly operations by utilizing both egocentric and exocentric video recordings. By jointly encoding temporal and multimodal information from video and narration, the authors derive structured task representations that enhance procedural documentation and provide context-aware guidance for workers. The evaluation on a real-world disassembly case study reveals that video-based representations significantly outperform traditional static image-based methods in capturing procedural structure and execution context.
Video-based task representations can revolutionize how we document and guide assembly processes, outperforming static methods in capturing critical procedural nuances.
Assembly and disassembly processes rely on expert knowledge that is difficult to document, reuse, and transfer. This paper presents a data-centric approach for extracting structured task knowledge from expert demonstrations using egocentric and exocentric recordings. Temporal and multimodal information from video and narration is jointly encoded to derive structured task representations that enable procedural documentation and context-aware worker guidance. The approach is evaluated on a real-world disassembly case study, demonstrating that video-based representations capture procedural structure and execution context beyond static image-based methods. The results highlight the potential of egocentric video understanding for repair, training, and circular manufacturing applications. Project website: https://indego-assistant.github.io/