Search papers, labs, and topics across Lattice.
This study reveals that large language models (LLMs) can inherently encode self-recognition signals in their outputs, which can be amplified through targeted interventions. By steering the internal residual stream with a random sparse vector, the authors create a detectable fingerprint that allows for accurate attribution of generated text to specific LLMs. The method achieves over 98% detection accuracy while maintaining the quality of the generated content, offering a novel approach to content attribution amidst the rise of AI-generated text.
LLMs can self-recognize their outputs with over 98% accuracy, providing a powerful tool for content attribution without sacrificing quality.
Recent advances in interpretability suggest that large language models (LLMs) implicitly encode signals in their generated text that enable self-recognition of their outputs. We demonstrate that this capability is reliable, even in low-entropy scenarios, and that it can be amplified through targeted intervention. By steering the internal residual stream during generation with a random sparse vector, we create a detectable fingerprint that enables attribution of a given text to a specific LLM. This signal is recoverable from the activations of an LLM used as a detector, achieving over 98% accuracy across multiple detection settings while preserving the quality of generated text. As AI-generated content proliferates, this approach offers a practical alternative to traditional detectors by leveraging the model's natural representation structure for attribution rather than embedding a signal externally. Our contributions include: (i) establishing reliable self-recognition capabilities in LLMs, (ii) a simple steering mechanism enabling multi-LLM identification with no quality degradation, (iii) demonstrating that activation spaces contain exploitable structure for encoding signals without semantic interference.
