Search papers, labs, and topics across Lattice.
This paper introduces the LLM-GNN Soft Prompt Framework (LGSPF) for fraud detection, addressing the limitations of existing methods that rely on text attributes or distort graph structures through hard prompts. LGSPF uses soft prompts to bridge the graph structure and semantic space, coupled with a parallel GNN encoder to translate multi-relational topologies into graph tokens for LLM comprehension. Experiments on fraud detection benchmarks show that LGSPF achieves state-of-the-art performance and enhances semantic interpretability.
Ditch the text: this new framework uses soft prompts to let LLMs directly reason over graph structures for fraud detection, achieving SOTA performance without relying on node attributes.
In recent years, Large Language Models (LLMs) have shown great capability in processing graph tasks such as fraud detection. However, most existing methods rely heavily on rich text attributes, which poses difficulties for this domain due to the lack of textual data. Although some pioneering methods attempt to overcome it, their textualization of graph structures via hard prompts easily leads to feature distortion. Additionally, fraud detection often exhibits multi-relational complexity, where current methods struggle to capture this deep semantic information. To address these challenges, we propose LLM-GNN Soft Prompt Framework (LGSPF). Specifically, LGSPF bridges the graph structure and semantic space using soft prompt to eliminate reliance on text. We further introduce a parallel Graph Neural Network (GNN) encoder to translate multi-relational topologies into graph tokens for fine-grained LLM fraud comprehension. Through end-to-end optimization, LGSPF enhances deep semantic alignment between LLM and GNN. Experiments across diverse fraud detection benchmarks demonstrate our method achieves state-of-the-art performance. Moreover, we further validate the contribution of LGSPF on enhancing the semantic interpretability of fraud behaviors.