Euntae Kim

KidnapRAG reveals how a clever sequence of poisoned documents can subvert the reasoning of advanced RAG systems, showcasing a critical vulnerability in their design.

LLMs are alarmingly vulnerable to jailbreak attacks when used for collaborative writing, capable of being tricked into generating harmful content from seemingly innocuous drafts.