Search papers, labs, and topics across Lattice.
This paper introduces a digital twin-driven robotic sorting system for textile classification and foreign object recognition, addressing the need for automation in sustainable textile recycling. The system uses a dual-arm robot with RGBD sensing, tactile feedback, and collision-aware motion planning to separate, inspect, and classify garments using Visual Language Models (VLMs). Benchmarking nine VLMs, the study finds that the Qwen model family achieves the highest overall accuracy (87.9%) in classifying textiles and detecting foreign objects, while lighter models offer speed-accuracy trade-offs for edge deployment.
Qwen VLMs achieve 87.9% accuracy in classifying textiles and detecting foreign objects in a robotic sorting system, demonstrating the potential for AI-powered automation in textile recycling.
The increasing demand for sustainable textile recycling requires robust automation solutions capable of handling deformable garments and detecting foreign objects in cluttered environments. This work presents a digital twin driven robotic sorting system that integrates grasp prediction, multi modal perception, and semantic reasoning for real world textile classification. A dual arm robotic cell equipped with RGBD sensing, capacitive tactile feedback, and collision-aware motion planning autonomously separates garments from an unsorted basket, transfers them to an inspection zone, and classifies them using state of the art Visual Language Models (VLMs). We benchmark nine VLM s from five model families on a dataset of 223 inspection scenarios comprising shirts, socks, trousers, underwear, foreign objects (including garments outside of the aforementioned classes), and empty scenes. The evaluation assesses per class accuracy, hallucination behavior, and computational performance under practical hardware constraints. Results show that the Qwen model family achieves the highest overall accuracy (up to 87.9 %), with strong foreign object detection performance, while lighter models such as Gemma3 offer competitive speed accuracy trade offs for edge deployment. A digital twin combined with MoveIt enables collision aware path planning and integrates segmented 3D point clouds of inspected garments into the virtual environment for improved manipulation reliability. The presented system demonstrates the feasibility of combining semantic VLM reasoning with conventional grasp detection and digital twin technology for scalable, autonomous textile sorting in realistic industrial settings.
