Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces MAGIC3, a multimodal fake news detector for short-form videos that leverages inconsistencies between text, visual, and audio modalities. MAGIC3 explicitly models pairwise and global consistency, incorporates style-robust text representations from LLM rewrites, and uses an uncertainty-aware classifier for selective VLM routing. Experiments on FakeSV and FakeTT datasets demonstrate that MAGIC3 achieves comparable accuracy to VLMs with significantly higher throughput and lower VRAM usage.
Fake news in short videos often betrays itself through subtle inconsistencies between text, visuals, and audio, a weakness MAGIC3 exploits to achieve VLM-level accuracy at a fraction of the cost.
Short-form video platforms are major channels for news but also fertile ground for multimodal misinformation where each modality appears plausible alone yet cross-modal relationships are subtly inconsistent, like mismatched visuals and captions. On two benchmark datasets, FakeSV (Chinese) and FakeTT (English), we observe a clear asymmetry: real videos exhibit high text-visual but moderate text-audio consistency, while fake videos show the opposite pattern. Moreover, a single global consistency score forms an interpretable axis along which fake probability and prediction errors vary smoothly. Motivated by these observations, we present MAGIC3 (Modal-Adversarial Gated Interaction and Consistency-Centric Classifier), a detector that explicitly models and exposes cross-tri-modal consistency signals at multiple granularities. MAGIC3 combines explicit pairwise and global consistency modeling with token- and frame-level consistency signals derived from cross-modal attention, incorporates multi-style LLM rewrites to obtain style-robust text representations, and employs an uncertainty-aware classifier for selective VLM routing. Using pre-extracted features, MAGIC3 consistently outperforms the strongest non-VLM baselines on FakeSV and FakeTT. While matching VLM-level accuracy, the two-stage system achieves 18-27x higher throughput and 93% VRAM savings, offering a strong cost-performance tradeoff.