Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces TEIDAN, a multilingual multimodal corpus comprising spontaneous three-party conversations in Japanese and English, designed to enhance research in multi-party dialogue systems. By utilizing individual pin microphones and participant-facing cameras, the corpus facilitates detailed analysis of turn-taking and addressee recognition in naturalistic settings. The preliminary analyses demonstrate TEIDAN's potential to advance understanding of multimodal grounding in both human-human and human-agent interactions, with plans for future expansion to additional languages.
TEIDAN reveals how multilingual, spontaneous dialogue can transform our understanding of group conversation dynamics in AI systems.
Multi-party interaction is a central setting for human communication and a necessary target for human-agent interaction systems that must participate in group conversation. Yet available corpora often focus on meetings, task-oriented interaction, text-based interaction, or acted scenarios, and fewer resources support cross-linguistic comparison of spontaneous face-to-face triadic discussion. This paper presents TEIDAN, a multilingual multimodal corpus that currently consists of Japanese and English three-party conversations. TEIDAN records groups of three participants discussing open-ended topics with individual pin microphones, a microphone array, and participant-facing cameras, and provides IPU-based transcripts for both language portions. Earlier studies used subsets of the Japanese portion for task-specific benchmarks in multi-party dialogue modeling; in contrast, this paper presents TEIDAN as a corpus resource spanning both Japanese and English, with planned expansion to additional languages. We describe the collection design, participants, recording setup, transcription format, and corpus statistics, and provide preliminary analyses to illustrate how TEIDAN can support research on turn-taking, addressee recognition, and multimodal grounding in human-human and human-agent interaction.