Search papers, labs, and topics across Lattice.
This paper introduces Counter Scam, a unified LLM-based multiagent framework designed to enhance the response to online scams by integrating detection and investigation processes. By leveraging insights from 37 stakeholders and emphasizing safe data guidelines, the framework incorporates specialized NLP tasks and a comprehensive corpus of scam data to improve analytical efficiency. Experimental results indicate that fine-tuned small LLMs outperform commercial models by over 10% in relevant tasks and achieve a notable improvement in scam-specific named entity recognition (NER).
Fine-tuned small LLMs can significantly outperform commercial models in scam detection tasks, enabling faster and more effective responses to online scams.
The rapid evolution of online scams, driven by transnational networks and mass produced social engineering scenarios, has exposed the speed limitations of conventional detection, necessitating tighter interagency coordination. While LLMs show promise in scam identification, their role in accelerating integrated response frameworks remains underexplored. We propose Counter Scam, a unified LLM based multiagent framework that orchestrates end to end response from initial detection to crime investigation. The framework first proposes safe data guidelines, emphasizing nonpublic scam data and secure dataset construction via scam specific NER. Developed with insights from 37 stakeholders to reduce delays and improve analytical efficiency, the system integrates CSRA for multiagent mitigation, CSRT comprising nine role aligned NLP tasks, and CSRD, a corpus of 185,300 scam cases and 38,587 knowledge entries. Experiments show that fine tuned sLLMs surpass commercial models by more than 10% across all CSRT tasks and achieve a 0.24 F1 improvement in scam specific NER. These results demonstrate the framework's capability to enable rapid and collaborative mitigation of online scams.
