Search papers, labs, and topics across Lattice.
To resolve boundary error propagation and context fragmentation in scalable segment-then-caption video processing, the authors introduce CausalChapter, a framework that models interventional dependencies across temporal windows. Directly deploying long-context LLMs across content-dense lecture transcripts is compute-prohibitive and prone to failure over smooth topic transitions, demanding principled dependency tracking rather than brittle heuristics. Evaluated on long-video chaptering benchmarks, the method substantially improves boundary localization precision, chapter description quality, and cross-chapter coherence without relying on full-context LLM inference.
Cheap segment-then-caption video pipelines can overcome boundary drift and context fragmentation once temporal shifts and historical context are governed by interventional dependency modeling rather than raw sequential attention.
Long-form instructional videos require automatic chaptering to support browsing, navigation, and knowledge access. Recent long-context language models can perform chaptering from textualized video inputs, but they remain costly and brittle for content-dense lecture videos with long transcripts, smooth topic transitions, and detailed chapter outputs. A scalable segment-then-caption paradigm reduces this cost, but introduces two new challenges: boundary error propagation and fragmented cross-chapter context. We propose \textbf{CausalChapter}, an intervention-inspired framework for long-video chaptering that estimates prediction-level influence through lightweight masking and removal interventions. For boundary localization, our Local Dependency Shift module detects drops in predictive dependency between adjacent temporal windows; for chapter description generation, our Cross-Segment Support Selection module reranks historical contexts according to their support for the current prediction. Experiments on long-video chaptering benchmarks show that CausalChapter improves boundary localization, chapter description quality, and cross-chapter coherence.
