Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Latent-IM, a framework for managing dialogue interactions within speech-based LLMs by separating the selection and realization of conversational moves. By framing dialogue management as coupled selection and realization tasks, the authors demonstrate that their approach can effectively recover dialogue management capabilities that are typically lost in LLMs. The key result shows a 12.5-point improvement in end-to-end move accuracy compared to unsteered models, while maintaining performance levels similar to fine-tuning methods.
Achieving a 12.5-point boost in dialogue move accuracy, Latent-IM reintroduces structured interaction management into LLMs without sacrificing performance.
Classical spoken dialogue systems often separated dialogue management from response realization: a policy selected the next dialogue action, and a generation component expressed that action. As dialogue systems shift toward LLMs, this decomposition has largely disappeared into the model's hidden representations. We ask whether an LLM-internal analogue of state estimation and action control can be recovered for conversational moves such as acknowledging, checking, querying, explaining, and replying. We formulate move control as two coupled problems: selection, predicting the appropriate next move from the dialogue context, and realization, causally producing a chosen move at generation time. We introduce Latent-IM, an internal dialogue-management framework that provides a general interface for choosing and deploying conversational moves under different objectives. Here, we use this control to reproduce human move choices, improving average end-to-end move accuracy by 12.5 points over the unsteered backbone while performing comparably to fine-tuning.