Search papers, labs, and topics across Lattice.
This paper details a prizewinning solution for the LeHome Challenge 2026, focusing on bimanual garment folding, where the system achieved 1st place in the online simulation round and 2nd in the real-world final. The approach enhances a vision-language-action (VLA) policy through a novel reinforcement-learning loop, where the same neural network predicts both actions and success metrics, enabling real-time failure detection and candidate selection. Key innovations include a combination of existing RL techniques and engineering optimizations, such as AWR + RECAP for flow-matching and an asynchronous training pipeline utilizing HuggingFace Hub.
The system's unique self-evaluating policy not only folds garments but also predicts its own success, revolutionizing the way we approach robotic manipulation tasks.
I describe my solution to the LeHome Challenge 2026, an ICRA 2026 competition on bimanual garment folding. The system placed 1st of 62 teams in the online (simulation) round and 2nd in the real-world final. It improves a vision-language-action (VLA) policy with a reinforcement-learning loop. The policy is its own value function: the same network that predicts actions also predicts success, progress, and a few task-relevant future quantities, and those predictions drive advantage estimation, live failure detection, and candidate selection. The work mostly recombines existing RL ideas with engineering and optimization contributions that can be used together as one recipe or individually: AWR + RECAP combined for flow-matching VLA; an asynchronous distributed training / rollout pipeline through HuggingFace Hub; inference-time hyperparameters optimization via Thompson sampling; a sim-to-real recipe with camera-alignment tooling, heavy augmentation and DAgger-like HIL data collection.
