Search papers, labs, and topics across Lattice.
This paper introduces FurnitureVLA, a novel approach to real-scale bimanual furniture assembly using Vision-Language-Action models, addressing the limitations of previous work that focused on simpler tasks. The authors developed a scalable simulation pipeline for generating expert data and a VR teleoperation system for collecting high-quality demonstrations, which enabled the system to handle complex assembly tasks with up to 1550 control steps. By implementing a progress-enhanced VLA that predicts actions alongside a continuous progress signal, they achieved a significant improvement in simulation success rates from 48% to 80%, demonstrating the effectiveness of their method in real-world scenarios with minimal performance drop on physical robots.
Achieving an 80% success rate in complex bimanual furniture assembly tasks marks a significant leap in robotic manipulation capabilities.
Current work on robot furniture assembly mostly focuses on toy-scale settings or single-arm manipulation. We introduce FurnitureVLA, the first systematic study of real-scale bimanual furniture assembly using Vision-Language-Action models (VLAs). We formalize the task, develop a scalable simulation pipeline for expert data generation and evaluation, and build a VR teleoperation system for single-operator bimanual control to collect high-quality real-world demonstrations. To address extreme long-horizon assembly with up to 7 subtasks and 1550 control steps, we propose a progress-enhanced VLA, finetuned on semantically grounded subtasks, that jointly predicts actions and a continuous progress signal, enabling automatic subtask transitions and reducing compounding errors during inference. We further study perception and control design factors that critically affect precision in real-scale assembly. FurnitureVLA improves average simulation success from 48% to 80% compared to baselines across three furniture types, with an additional 21% gain from our design factor study. We validate on a real Kinova Gen3 platform with only 16% drop on the hardest task.
