Search papers, labs, and topics across Lattice.
This paper introduces SenseShift, an encoder-based framework for continuous sentiment-controlled text generation that addresses the limitations of traditional decoder-based models. By employing bidirectional attention and iterative mask infilling, SenseShift enables fine-grained, sentence-level sentiment control, allowing for more nuanced and contextually relevant text generation. Empirical evaluations reveal that SenseShift outperforms larger decoder-based models in both sentiment controllability and text quality, particularly in long-form contexts.
Fine-grained sentiment control in text generation is now possible, with SenseShift achieving superior results over traditional decoder-based approaches.
Recent controllable text generation (CTG) for sentiment control has largely focused on decoder-based large language models, making causal attention the dominant paradigm. While effective for fluent generation, these models still struggle to satisfy complex constraints and follow fine-grained sentiment signals specified by users. Existing sentiment-aware CTG methods typically simplify the problem by treating sentiment either as a coarse categorical label (e.g., positive or negative) or as a single fine-grained control signal applied to an entire document. Consequently, more challenging settings such as sentence-level sentiment control within long-form text remain underexplored. To address these limitations, we introduce SenseShift , an encoder-based framework for fine-grained sentence-level CTG. Unlike standard decoder architectures, SenseShift leverages bidirectional attention, quantized sentiment signals, and iterative mask infilling to generate local sentences conditioned on target sentiment intensity. Empirical evaluations on story and review generation demonstrate that SenseShift achieves stronger sentiment controllability while maintaining text quality and robustness to out-of-domain generation compared to larger decoder-based baselines.
