Search papers, labs, and topics across Lattice.
This paper introduces a Data Quality Assessment and Feedback (DQAF) framework for teleoperation that provides immediate post-episode feedback based on semantic task progress and robot telemetry. The framework extracts quality signals like sub-task completion, motion smoothness, and kinematic limit violations, converting them into structured assessments and natural language feedback. A pilot study with novice operators showed that DQAF-guided teleoperation leads to faster improvement and higher-quality demonstrations compared to unguided teleoperation.
Real-time feedback on robot demonstrations, going beyond simple success/failure, accelerates learning for novice teleoperators and yields higher-quality training data.
Industrial automation is at a pivotal moment, as Physical AI is driving a transition from rigid, hand-engineered automation systems toward more flexible and adaptive systems. This shift has created a growing demand for large-scale, real-world robot demonstration data, making teleoperation an increasingly important mechanism for data collection. However, high-quality teleoperated demonstrations remain difficult to obtain in practice, as novice operators often produce episodes that are task-successful but suboptimal for downstream use due to inefficient motion, repeated corrections, or operation near robot joint limits. We present a Data Quality Assessment and Feedback (DQAF) framework that closes the loop in teleoperation by providing immediate post-episode feedback grounded in semantic task progress and robot telemetry. The framework extracts quality relevant signals such as sub-task progress, motion smoothness, stalls, kinematic limits and converts them into structured quality assessments and actionable natural-language feedback. Unlike binary success or failure feedback, the proposed system explains why an episode is suboptimal and highlights specific behaviors to correct in the next trial. We evaluate the framework through a diagnostic validation study and a pilot user study. In the validation study, the system is compared with a human reviewer during dataset curation, producing rejection reasons and actionable feedback for improvement. In the pilot study with three novice operators across two manipulation tasks, the operator who received the systems immediate, automated post-episode feedback improved faster than those who did not, producing higher-quality demonstrations sooner.
