Search papers, labs, and topics across Lattice.
This paper introduces a unified detection framework utilizing Mahalanobis distance scores (MDS) to identify AI-generated content and artifacts across various contexts, including large language model outputs and adversarial examples. The framework's effectiveness hinges on accurately characterizing positive classes through robust covariance matrix estimation, employing joint methods for both casewise and cellwise minimum covariance determinant estimators. Empirical results demonstrate the framework's superior detection capabilities, underscoring its potential as a cost-effective oversight tool for AI deployment.
A unified detection framework reveals that accurately estimating covariance can significantly enhance the identification of AI-generated artifacts across multiple domains.
Artificial intelligence (AI) is a double-edged sword: while it has achieved remarkable success across a wide range of domains, its deployment also calls for effective oversight and regulation, for which the detection of AI-related content and artifacts is perhaps the most direct and cost-effective approach. To this end, we propose a unified detection framework based on Mahalanobis distance scores (MDS), applicable to several important settings, including the detection of large language model (LLM) generated text, hallucination, watermark, and adversarial examples. A key component of the proposed method is to accurately characterize the positive class--such as human-generated text, factual statements, unwatermarked text, or non-adversarial samples--which requires an efficient and robust estimator of the covariance matrix of deep representations of positive samples before computing the MDS. Since the positive samples typically consist of multiple classes, and these classes may exhibit both homogeneity and heterogeneity, we develop joint estimation methods for both the casewise and cellwise minimum covariance determinant (MCD) estimators. We provide efficient optimization algorithms for both estimators and prove their convergence. We provide a reasonable definition of the breakdown point for the joint estimators and prove their corresponding high breakdown point properties. Empirical evaluations confirm the effectiveness of the proposed detection framework.
