Search papers, labs, and topics across Lattice.
This paper introduces FADE, a novel training framework designed to enhance counterfactual video understanding by shifting from passive verification to active discovery. By employing a two-stage training paradigm that combines evidence-internalized supervised fine-tuning with a fading-anchor reinforcement learning strategy, FADE enables models to independently uncover and explain visual anomalies without relying on textual cues. The results demonstrate that FADE significantly outperforms existing models, achieving state-of-the-art performance across multiple tasks while maintaining high robustness during the transition from multiple-choice questions to open-ended tasks.
FADE achieves a remarkable 90.4% performance retention in unconstrained open-ended tasks, far surpassing the 48.1% retention of GPT-5.6, revolutionizing counterfactual video understanding.
Counterfactual video understanding evaluates whether models grasp physical and commonsense regularities. However, existing multiple-choice question (MCQ) benchmarks inadvertently leak target events through their questions and candidate options. This reduces the core challenge from active discovery to text-guided verification. In this paper, we present FADE, an effective training framework for counterfactual discovery and explanation. Our method is built on an evidence-first, two-stage training paradigm. First, evidence-internalized supervised fine-tuning grounds the model's predictions in decisive visual anomalies. Second, we apply a fading-anchor reinforcement learning strategy that progressively removes textual guidance, compelling the model to independently discover and explain evidence. To rigorously evaluate this capability, we also introduce an effective pipeline that converts existing MCQ datasets into aligned MCQ, open-ended question answering (OQA), and captioning tasks without requiring additional data curation. Our simple approach yields strong results. Using Qwen3-VL-8B as the baseline, FADE achieves state-of-the-art strict paired scores across all three tasks on DualityVidQA-test and IPV-Bench, outperforming GPT-5.6. In specific, when transitioning from constrained MCQs to unconstrained OQA and captioning, our model demonstrates remarkable robustness. Its performance retention is 90.4% and 67.4% on DualityVidQA-test-substantially higher than the 48.1% and 30.7% retained by GPT-5.6. We hope this simple framework can serve as a solid baseline for future research in unconstrained counterfactual video understanding.
