Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel diffusion-based framework called DETECT-REMASK-REPAIR for localized faithfulness repair in summarization, addressing the challenge of outdated summaries in evolving contexts. By focusing on updating only the unsupported spans of a summary while preserving the supported content, the method demonstrates significant improvements in both efficiency and faithfulness compared to full regeneration. Experiments reveal that this approach not only reduces repair time to under half a second but also allows for controllable trade-offs between faithfulness and speed across various datasets.
Localized diffusion repair can enhance summary accuracy without the overhead of complete rewrites, achieving repairs in under half a second.
Summaries of real-world events can become outdated as contexts evolve and new information arrives. A common response is to generate a new summary from the updated context, but full regeneration discards the previous draft, can obscure what changed, and may be unnecessary when only a few claims are unsupported. We study localized faithfulness repair: updating outdated spans in an existing summary while preserving supported content. We propose DETECT-REMASK-REPAIR, a diffusion-based framework that identifies, remasks, and repairs outdated regions with masked diffusion language models. To evaluate evolving-context summarization, we introduce StreamSum, a benchmark of synthetic event timelines. Experiments on DialogSum and StreamSum show that localized diffusion repair provides a controllable alternative to full rewriting: faithfulness-steered repair improves early drafts, one-step repair reduces repair cost to under half a second, with the framework enabling faithfulness-speed-preservation tradeoffs across datasets. We also find that the framework can provide a post-hoc correction step that improves faithfulness for autoregressive systems.