Search papers, labs, and topics across Lattice.
This paper introduces SSMNBench, a diagnostic benchmark designed to evaluate the cross-view human-object understanding capabilities of Multimodal Large Language Models (MLLMs) through 3,300 curated QA pairs. By categorizing tasks into Single-View Sufficiency (SVS) and Multi-View Necessity (MVN), the authors reveal that current MLLMs exhibit significant "distraction degradation" when faced with redundant views and struggle to synthesize fragmented geometric evidence from multiple perspectives. The findings highlight that existing models predominantly rely on single-image semantic averaging rather than true cross-view integration, underscoring critical limitations in their reasoning abilities.
Current MLLMs are more prone to distraction than previously thought, revealing a reliance on single-view semantics over genuine cross-view reasoning.
Multimodal Large Language Models (MLLMs) have shown remarkable progress in single-image perception, yet their ability to reason about complex cross-view human-centric scenes remains largely unverified. Current multi-view benchmarks evaluate models using a fixed "bag of frames" and thus conflate a model's robustness to visual distraction with its genuine ability to fuse fragmented cross-view evidence. To address this issue, we introduce SSMNBench, a diagnostic benchmark comprising 3,300 curated QA pairs for cross-view human and human-object understanding. SSMNBench uniquely categorizes tasks into Single-View Sufficiency (SVS) and Multi-View Necessity (MVN). By systematically perturbing view availability across 17 state-of-the-art MLLMs, critical limitations are revealed: models suffer from severe "distraction degradation" when presented with redundant views (SVS), and fail to integrate fragmented geometric evidence across cameras (MVN). Our evaluations demonstrate that modern MLLMs rely on multiple single-image semantic averaging and view preference rather than genuine cross-view synthesis. By exposing these fundamental vulnerabilities, SSMNBench provides a rigorous diagnostic framework to drive the advancement of future cross-view-aware multimodal architectures. The code is available at: $ \href{https://github.com/gtc-gh/SSMNBench}{\text{SSMNBench}} $
