Search papers, labs, and topics across Lattice.
The paper introduces a bimanual XR interface for specifying assembly tasks to robots as hierarchies of constraints. The system allows users to define both relative and absolute spatial relationships between objects, enabling a mix of user-defined precision and robot-determined optimization. The key result is a novel method for specifying complex assembly tasks in XR that balances user control and robotic autonomy.
Unleash robotic assembly efficiency by letting robots decide where to build subassemblies, guided by your high-level XR constraints.
We present a bimanual XR interaction approach for specifying remote assembly tasks as hierarchies of relative and absolute object constraints that specify high-level teleoperation goals for robots. Grabbing one object in each hand creates a constraint group (visualized as a hull) and groups can be nested into hierarchies. Each group can be relative (with a robot-specifiable 6DoF pose) or absolute (with an author-specified fixed 6DoF pose) in relation to its parent. A relative group specifies a subassembly that can be constructed at a location chosen by the robot software for efficiency rather than mandated by the user.
