Search papers, labs, and topics across Lattice.
This paper introduces FinRED, a specialized benchmark framework for evaluating the safety of financial large language models (LLMs) by addressing finance-specific risks such as regulatory compliance violations and fraud. The framework employs a two-level taxonomy that aligns global standards with specific threats, generating context-rich red-teaming prompts validated by financial experts, which significantly reduces critical false negatives in safety evaluations. Deployed in South Korea's Financial Security Institute, FinRED represents a significant advancement in ensuring the safety and compliance of generative AI in financial services.
Financial LLMs can now be rigorously evaluated against targeted risks, reducing critical false negatives in safety assessments from 28 to 12.
Existing safety benchmarks target general adversarial scenarios but miss finance-specific risks. Financial LLMs face regulatory compliance violations, fraud facilitation, and systemic trust erosion that require targeted evaluation. We introduce FinRED, an expert-guided red-teaming framework for financial LLM safety evaluation developed with financial experts. FinRED uses a novel two-level taxonomy mapping global standards (e.g., FATF and EU DORA) to threats ranging from regulatory evasion to complex fraud, integrated with a scalable pipeline that converts real financial documents into context-rich red-teaming Behavioral Prompts (seeds) through an expert-defined schema. Rigorous expert validation confirms seed plausibility and realism for meaningful LLM safety evaluation. We also provide an expert-validated, finance-specific rubric that goes beyond disclaimer checks, aligns more closely with human experts than static one-size-fits-all rubrics, and reduces critical false negatives from 28 to 12. Aligned with internationally adopted risk-management and information-security standards (e.g., ISO/IEC 27001), FinRED is deployed in South Korea's Financial Security Institute (FSI) regulatory sandbox for generative AI security evaluation in real financial services. To mitigate dual-use risks, the dataset, generation pipeline, prompt template, and evaluation framework are gated for qualified researchers at https://github.com/selectstar-ai/FinRED-paper and https://huggingface.co/datasets/datumo/FinRED.
