Search papers, labs, and topics across Lattice.
This survey explores the integration of automatic speech recognition (ASR) technologies in robotic systems, highlighting the shift from traditional API services to localized models. It details the evolution of ASR methods, including deep learning advancements like OpenAI's Whisper, and categorizes deployment strategies such as ROS-based, cloud-based, and hybrid solutions. Key challenges and future directions for robust speech recognition in dynamic environments are also discussed, providing valuable insights for researchers in social robotics.
Localized ASR models could revolutionize human-robot interaction by enabling more intuitive and responsive communication in real-time environments.
Automatic speech recognition (ASR) has become a critical component of modern robotic systems because it is one of the most natural and intuitive ways for humans to interact with robots. A commonly used method is to directly use API services online. But is that all we can do? This article provides an overview of how ASR technologies are integrated into various intelligent robots and machines. We discuss the evolution of speech recognition from established approaches to state-of-the-art deep learning models, such as OpenAI's Whisper. We also list large-scale datasets and open source toolkits that have been widely used in both industry and academia. We structure the survey around ASR model families, deployment strategies in robotics (especially ROS-based, cloud-based, and hybrid solutions), and several real-world robotic platforms. Finally, we outline the challenges of deploying robust speech recognition in robots and discuss future directions, including multimodal interaction in diverse and dynamic environments. This paper can help social robotics researchers better navigate the emerging domain of language-based natural human-robot interaction.
