Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Stemma, a novel method for LLM provenance testing that maps open-ended outputs into finite decision regions, allowing for a more reliable assessment of model lineage. By focusing on the inheritance of decision regions rather than surface-level response characteristics, Stemma demonstrates superior performance in distinguishing related models from unrelated ones. Empirical results show that Stemma achieves an AUC of 0.967 and a true positive rate of 87.8% at 1% false positive rate across a wide range of model transformations and deployment scenarios, significantly outperforming existing methods.
Stemma reveals that decision region inheritance is a more reliable indicator of LLM lineage than traditional response-level characteristics, achieving remarkable accuracy across diverse model deployments.
LLM provenance testing asks whether a suspect LLM belongs to the same lineage as a source. Existing black-box methods largely infer this relationship from response-level characteristics, but these characteristics may shift under adaptation or deployment even when the underlying meaning remains unchanged, weakening the reliability of provenance evidence. To address this limitation, we introduce induced decision regions by mapping open-ended outputs into a finite decision space, thereby abstracting away surface-form variation and reframing provenance testing as measuring the inheritance of decision regions. Empirical analysis shows that the source's induced regions are preserved more strongly in related models than in unrelated models. Building on this signal, we propose Stemma, a practical black-box LLM fingerprinting method that operationalises stability, robustness, and specificity as complementary probe-selection principles for reliably estimating induced decision region inheritance. Across 770 source-suspect pairs drawn from 56 public checkpoints and spanning diverse model-weight transformations, Stemma achieves 0.967 AUC and 87.8% TPR at 1% FPR, substantially outperforming four representative baselines. It further achieves 0.995 AUC and 93.5% TPR at 1% FPR on 1,260 pairs covering 91 deployment instances, demonstrating robustness to diverse inference-time deployment settings.