Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Receipt Replay OOD, a new benchmark dataset for evaluating the out-of-domain (OOD) robustness of screen replay detection models. The dataset uses receipts, which share characteristics with identity documents but avoid PII concerns, to create a realistic domain shift scenario. Experiments demonstrate a significant drop in generalization performance when models trained on identity documents are evaluated on the receipt dataset, highlighting the challenge of OOD robustness.
Screen replay detection models tank when faced with the humble receipt, revealing a surprising lack of generalization in current approaches.
Public datasets such as DLC-2021, SynID, and KID34K have significantly contributed to research on presentation attack detection for identity documents, including screen replay attacks. However, evaluation of out-of-domain (OOD) robustness remains insufficiently explored, especially under realistic domain shifts. In this work, we introduce Receipt Replay OOD, a small out-of-domain benchmark for screen replay detection. Receipts share several characteristics with identity documents, including planar geometry, curved corners, wear-and-tear artifacts, and text or logo patterns, while avoiding personally identifiable information constraints commonly associated with identity documents. We evaluate document replay detection models under cross-domain conditions and demonstrate the impact of domain shift on generalization performance. The dataset is publicly available.