Search papers, labs, and topics across Lattice.
This paper introduces the Counterfactual Reasoning framework for fine-grained Evidence Disentanglement (CREDiT) to enhance VideoQA systems by addressing their reliance on spurious correlations. By employing a structural causal model, CREDiT decomposes cross-modality representations into causal and non-causal components, utilizing feature-level causal interventions to suppress non-causal correlations. Experimental results on multiple datasets show that CREDiT significantly improves answer accuracy and reasoning reliability, making VideoQA systems more trustworthy in complex scenarios.
CREDiT reveals how counterfactual reasoning can disentangle causal evidence from confounding factors, leading to a dramatic boost in VideoQA accuracy.
Recent advances in video multimodal models have significantly improved VideoQA performance. However, these systems often rely on spurious statistical correlations rather than answer-relevant causal evidence, resulting in unfaithful and brittle reasoning, especially in complex real-world scenarios. Existing methods either rely on cross-modality correlations, costly curated training resources, or insufficient causal assumptions and constraints, and typically operate at the time-interval level. As a result, they fail to explicitly disentangle causal visual cues from confounders and provide limited fine-grained evidence localization. To address this issue, we propose a Counterfactual Reasoning framework for fine-grained Evidence Disentanglement (CREDiT). CREDiT formulates the VideoQA process using a structural causal model and learns cross-modality representations that are explicitly decomposed into causal and non-causal components under independence and minimality constraints. To facilitate faithful disentanglement, we introduce feature-level causal interventions and construct counterfactual inputs that approximate causal effects while suppressing non-causal correlations. Extensive experiments on NExT-GQA, SportsQA, and SPORTU-video demonstrate that CREDiT consistently improves answer accuracy and reasoning reliability across both generic and complex sports scenarios, leading to more trustworthy VideoQA systems.
