Search papers, labs, and topics across Lattice.
This paper introduces CounterFactual Policy Optimization (CFPO), a novel framework designed to enhance multimodal reasoning in Large Vision-Language Models (LVLMs) by incorporating counterfactual learning and causal consistency. The approach addresses grounding failures, where models prioritize language over visual evidence, by employing a cross-modal counterfactual enhancement mechanism that regularizes policy updates based on discrepancies between predictions and counterfactual states. Experimental results show that CFPO leads to significant improvements in reasoning fidelity, outperforming standard reinforcement learning baselines and the state-of-the-art perception-aware method by notable margins.
CFPO boosts multimodal reasoning in LVLMs by enforcing causal consistency, leading to significant improvements in reasoning fidelity.
Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in multimodal reasoning. However, prevailing reinforcement learning (RL) paradigms lack explicit counterfactual enhancement and causal learning mechanisms. This fundamental deficiency results in severe grounding failures, manifesting as a tendency to ignore visual evidence in favor of language priors or exhibiting hallucination drift during long chain-of-thought reasoning. To address this root cause, we propose CounterFactual Policy Optimization (CFPO), a novel framework that enforces causal consistency between visual perception and textual reasoning. CFPO introduces a cross-modal counterfactual enhancement mechanism, which regularizes the policy by maximizing the discrepancy between the model's predictions and those from a counterfactual state where critical visual cues are suppressed. This approach seamlessly integrates with standard algorithms like GRPO and DAPO without requiring external reward models or additional supervision. Extensive experiments demonstrate that CFPO significantly improves reasoning fidelity, achieving consistent gains of 3.17%-6.25% over standard RL baselines and 1.32%-2.13% over the state-of-the-art perception-aware method (PAPO). Code is available at https://github.com/Raven-July/CFPO.
