Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces TalkTag, an LLM-based tool designed to automate fine-grained morphosyntactic error annotation in spoken-language transcripts, particularly in low-resource settings. By leveraging children's narrative data and addressing the challenges of data scarcity, TalkTag achieves precise annotation while navigating the complexities of linguistic ambiguity. The results indicate that this tool not only enhances scalability in error annotation but also provides a practical solution for researchers in clinical and developmental language studies.
TalkTag automates morphosyntactic error annotation with surprising precision, even in low-resource contexts where traditional methods struggle.
Fine-grained morphosyntactic error annotation is important in clinical and developmental language research, yet it is labour-intensive, expert-dependent, and difficult to scale. We present TalkTag, an LLM-based lightweight tool fine-tuned to automate CHAT-style error annotation in spoken-language transcripts. Developed under conditions of extreme data scarcity using children's narrative data, the system shows the feasibility of linguistic analysis in low-resource settings. Our evaluation demonstrates that TalkTag produces encouragingly precise annotation while effectively identifying instances where linguistic ambiguity makes automated tagging genuinely complex. In summary, with TalkTag, we provide a scalable alternative to manual error annotation and practically viable support for morphosyntactic error annotation.