Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a KL-divergence regularization term to NDAP models, penalizing deviations from dialogue act transition matrices derived from the training corpus. Applied to a 60-class German counseling taxonomy, this regularization improves macro-F1 scores by 9-42% compared to baselines using pretrained encoders. The improvements generalize across languages and counseling domains, suggesting that incorporating dialogue-flow priors enhances performance, particularly for weaker models in data-sparse settings.
Injecting lightweight dialogue-flow statistics into next dialogue act prediction can yield surprisingly large gains, especially when data is scarce or your encoder is weak.
This paper studies how empirical dialogue-flow statistics can be incorporated into Next Dialogue Act Prediction (NDAP). A KL regularization term is proposed that aligns predicted act distributions with corpus-derived transition patterns. Evaluated on a 60-class German counselling taxonomy using 5-fold cross-validation, this improves macro-F1 by 9--42% relative depending on encoder and substantially improves dialogue-flow alignment. Cross-dataset validation on HOPE suggests that improvements transfer across languages and counselling domains. In systematic ablations across pretrained encoders and architectures, the findings indicate that transition regularization provides consistent gains and disproportionately benefits weaker baseline models. The results suggest that lightweight discourse-flow priors complement pretrained encoders, especially in fine-grained, data-sparse dialogue tasks.