Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study evaluates the impact of a 15 percentage point increase in task success on user perception in a multimodal human-robot interaction (HRI) system designed for object detection and grasping. By comparing a baseline system with an improved configuration that utilized advanced perception and language modules, the researchers conducted a within-subject user study with 24 participants. The results indicated that 70.83% of participants preferred the improved system, which was rated significantly higher across all perceptual constructs, highlighting the critical link between technical performance and user experience in HRI systems.
A 15% increase in task success led to a significant shift in user perception, with 70% of participants favoring the enhanced robot interaction system.
Improvements in the technical performance of human--robot interaction (HRI) systems do not automatically translate into differences that human users can detect during live interaction. This paper investigates whether a 15 percentage point gain in end-to-end task success (from 75% in a multimodal baseline system to 90% in an improved configuration identified through a prior ablation study) is sufficient to produce consistent and measurable differences in user perception. The baseline system combines Whisper for speech recognition, Florence-2 for open-vocabulary object detection, LLaMA 3.1 for action extraction, and an interval Type-2 fuzzy logic controller for motion execution. The improved configuration replaces the perception and language modules with Grounding DINO + SAM and Qwen 3.5 9B, respectively, while retaining the same controller. A within-subject user study with 24 participants compared both systems on the same tabletop object-grasping task. After interacting with each configuration, participants rated perceived speed, reliability, and overall competence and fluency on a 7-point Likert scale. Results show that 17 out of 24 participants (70.83%) preferred the improved system (exact binomial test, p = 0.043, h = 0.43), and all three perceptual constructs were rated significantly higher for the improved configuration after Holm correction, with large to very large effect sizes (p<0.001). These findings confirm that the identified technical improvements are perceptible to users in direct interaction and underscore the importance of complementing benchmark evaluation with user-centred evidence when assessing robotic manipulation pipelines.