Search papers, labs, and topics across Lattice.
This paper introduces a modular framework that separates the generation and selection processes in budget-constrained abstractive summarization, addressing common issues like factual inconsistency and redundancy. By employing a pretrained generator to create multiple candidate summaries and a combinatorial selector to optimize for relevance, factuality, and redundancy, the authors achieve significant improvements in factuality and source-grounding metrics across various datasets. Notably, while the approach sacrifices some reference overlap, human evaluations reveal enhanced perceived quality in terms of consistency, relevance, clarity, and conciseness.
Decoupling generation from selection leads to substantial gains in factual accuracy and relevance in summarization, even under strict budget constraints.
Abstractive summarization models remain vulnerable to factual inconsistency, redundancy, and weak length control. We propose a modular generation-and-selection framework for sentence-budget-constrained summarization. A pretrained generator produces multiple candidate summaries, which are decomposed into sentence-level candidates. A combinatorial selector then constructs the final summary by balancing relevance, factuality, and redundancy under an explicit budget. The framework supports MMR, ILP, and a DPP-inspired log-determinant objective without retraining the generator. Experiments on CNN/DailyMail, Multi-News, FaithBench, and TofuEval show consistent improvements in factuality and source-grounding metrics, especially for multi-document summarization, at the cost of lower reference-overlap scores. Human evaluation further indicates higher perceived consistency, relevance, clarity, and conciseness, with a small reduction in coherence. These results show that decoupling generation from selection provides a model-agnostic mechanism for improving factual grounding. Code is available at https://anonymous.4open.science/r/bcfs-D05E/.