Search papers, labs, and topics across Lattice.
This paper introduces HyperClaim, a novel discriminative temporal hypergraph framework designed for the fine-grained detection of video misinformation by capturing multi-way cross-modal dependencies among query phrases, contextual text, and temporal frame interactions. By constructing a sparse heterogeneous hypergraph and employing adaptive soft-incidence reasoning, HyperClaim effectively preserves the intricate relationships that traditional global multimodal fusion methods tend to overlook. The framework achieves notable accuracy improvements on the FactGuard temporal protocol, outperforming existing baselines with scores of 83.7%, 82.0%, and 87.3% on three benchmark datasets, highlighting its efficacy in authenticity classification.
HyperClaim outperforms traditional methods by achieving up to 87.3% accuracy in detecting video misinformation through advanced hypergraph reasoning that captures complex cross-modal interactions.
Video misinformation detection is often approached through global multimodal fusion or free-form multimodal reasoning. Both paradigms can under-represent localized authenticity cues that arise from coupled interactions among query phrases, contextual text, and short temporal spans of frames. Because such interactions are inherently higher-order, pairwise graph formulations are insufficient to capture multi-way cross-modal dependencies, whereas hypergraphs offer a suitable representation for these relations. We propose HyperClaim, a discriminative temporal hypergraph framework for sample-level authenticity classification. Using the title or benchmark-provided paired text as a claim-like query, HyperClaim constructs a sparse heterogeneous hypergraph over query tokens, evidence tokens, and sampled frames; applies confidence-aware filtering and source budgeting to form compact text-frame and short-range temporal evidence units; performs adaptive soft-incidence reasoning with residual text-video calibration; and aggregates textual, visual, and hyperedge states through a discrepancy-aware readout. Without relying on generated rationales or external tool calls, HyperClaim preserves fine-grained cross-modal and temporal structure that global fusion tends to flatten. Under the FactGuard temporal protocol, it achieves 83.7%, 82.0%, and 87.3% accuracy on FakeSV, FakeTT, and FakeVV, respectively, outperforming strong discriminative and reasoning-centric baselines. Learned incidence and attention weights further reveal token- and frame-level structure.
