Search papers, labs, and topics across Lattice.
This paper introduces MADreMIA, a model-agnostic framework that enhances membership inference attacks by leveraging chained generations across various modalities. By iteratively using model outputs as inputs, the method amplifies the membership signal, yielding significantly higher coherence and slower degradation for memorized training samples compared to non-member generations. The results indicate that MADreMIA can provide richer signals across different model families, improving the effectiveness of privacy auditing and copyright enforcement in generative models.
Iterative regeneration reveals that memorized samples maintain coherence far better than non-members, transforming how we approach membership inference in generative models.
The tendency of large generative models to memorize training data makes sample verification critical for privacy auditing and copyright enforcement. Current membership (MIA) and dataset inference (DI) attacks often rely on one-shot generations, which yield weak signals and limited sensitivity across modalities. Inspired by Model Autophagy Disorder (MAD), we introduce MADreMIA, a model-agnostic framework that enhances white-, gray-, and black-box MIA and DI. Rather than relying on shadow model training -- often infeasible for large generative models -- our framework facilitates scalable inference by leveraging inherent signals through iterative trajectories. This process utilizes chained generations across diverse modalities, where each output serves as the subsequent input, to improve membership evidence at low FPR. We demonstrate that memorized training samples exhibit significantly higher coherence and slower degradation during iterative regeneration than non-member generations. Our results show that MADreMIA provides richer signals across diverse model families and modalities; we present comprehensive evaluations for IARs, diffusion, and language models, alongside preliminary results demonstrating its potential for audio models.
