Search papers, labs, and topics across Lattice.
This paper benchmarks small language models (SLMs) for leader-follower role classification in human-robot interaction, using a new dataset derived from an existing database and augmented with synthetic samples. The study evaluates zero-shot and one-shot adaptation strategies, including prompt engineering and fine-tuning, against an untrained baseline using Qwen2.5-0.5B. Results show that zero-shot fine-tuning achieves 86.66% accuracy with 22.2 ms latency, outperforming baseline and prompt-engineered approaches, although one-shot performance degrades due to increased context length.
Surprisingly, fine-tuning a tiny 0.5B parameter language model achieves robust role classification in human-robot interaction, rivaling much larger models in zero-shot settings.
Leader-follower interaction is an important paradigm in human-robot interaction (HRI). Yet, assigning roles in real time remains challenging for resource-constrained mobile and assistive robots. While large language models (LLMs) have shown promise for natural communication, their size and latency limit on-device deployment. Small language models (SLMs) offer a potential alternative, but their effectiveness for role classification in HRI has not been systematically evaluated. In this paper, we present a benchmark of SLMs for leader-follower communication, introducing a novel dataset derived from a published database and augmented with synthetic samples to capture interaction-specific dynamics. We investigate two adaptation strategies: prompt engineering and fine-tuning, studied under zero-shot and one-shot interaction modes, compared with an untrained baseline. Experiments with Qwen2.5-0.5B reveal that zero-shot fine-tuning achieves robust classification performance (86.66% accuracy) while maintaining low latency (22.2 ms per sample), significantly outperforming baseline and prompt-engineered approaches. However, results also indicate a performance degradation in one-shot modes, where increased context length challenges the model's architectural capacity. These findings demonstrate that fine-tuned SLMs provide an effective solution for direct role assignment, while highlighting critical trade-offs between dialogue complexity and classification reliability on the edge.
