Search papers, labs, and topics across Lattice.
This paper evaluates the effectiveness of small language models (SLMs) in assisting with title and abstract screening for a systematic review in social-physical human-robot interaction (spHRI). Although SLMs did not match the performance of human reviewers, they significantly accelerated the screening process and identified 39 previously missed relevant papers, constituting 10.29% of the dataset. These findings highlight the potential of SLMs to enhance the efficiency of literature reviews while maintaining expert oversight.
SLMs can uncover over 10% of relevant papers in systematic reviews that human reviewers might miss, significantly speeding up the screening process.
Social-physical human-robot interaction (spHRI) has grown rapidly across robotics, human-computer interaction, human-robot interaction, and haptics. Yet, fragmented terminology and inconsistent methodologies make systematic synthesis difficult. To support scalable review practices, we evaluated the extent to which small language models (SLMs; < 1.5B parameters) can assist with title and abstract screening for a large spHRI systematic review. While no SLMs matched human reviewers' performance, the models operated locally and screened papers orders of magnitude faster. The combined SLM ensemble identified 39 papers reviewers missed, representing 10.29% of the final relevant dataset. These results demonstrate that SLMs can augment, rather than replace, expert reviewers and make large-scale literature reviews accessible and sustainable.
