Search papers, labs, and topics across Lattice.
This paper introduces a compositional forensic visual prompting framework for open-world face anti-spoofing that addresses both covariate and semantic shifts by leveraging a frozen ViT-based model. By utilizing patch-aware attention, the method refines learnable micro-forensic primitives into localized evidence units, enabling the adaptive composition of these primitives into effective prompts for distinguishing real from spoofed faces. The approach achieves state-of-the-art performance across nine open-world protocols, showcasing strong cross-domain generalization and resilience to previously unseen attack types.
By harnessing the power of micro-forensic primitives, this framework achieves unprecedented adaptability in face anti-spoofing, outperforming existing methods in open-world scenarios.
Open-world face anti-spoofing must address both covariate and semantic shifts: source and target domains differ in imaging conditions, while target domains contain diverse attack types absent from training. Existing prompt-based approaches often express spoofing through category semantics or language guidance, which is effective for modeling high-level concepts but is less suited to explicitly capturing the evolving fine-grained and spatially heterogeneous forensic evidence of unseen attacks. Motivated by the hypothesis that many unseen attacks can be characterized by new combinations of recurring visual cues, we propose a compositional forensic visual prompt learning framework that operates entirely in the visual feature space.Built on a frozen ViT-based vision foundation model, the framework employs patch-aware attention to refine a shared set of learnable micro-forensic primitives into localized forensic evidence units derived from image patches. Class-specific global contextual prompts then provide input-dependent routing weights that adaptively select and compose these primitives into compositional forensic visual prompts for real/spoof discrimination. The primitives are not assigned predefined semantic meanings; instead, their specialization and reuse emerge from shared parameterization and joint optimization across categories.Extensive experiments on nine open-world protocols demonstrate state-of-the-art performance, strong cross-domain generalization, and robust adaptation to unseen attacks.
