Search papers, labs, and topics across Lattice.
This study addresses the critical issue of detecting sensitive personal information (SCPI) in Japanese pre-training corpora for large language models, an area previously underexplored compared to English. By constructing a specialized SCPI dataset and employing LLM-based annotation, the authors trained machine learning models that successfully identify SCPI in text. The key finding reveals that their classifier can effectively detect SCPI, underscoring the unique challenges associated with this task in the Japanese language context.
The first-ever SCPI classifier for Japanese text reveals significant challenges in detecting sensitive information, crucial for compliance with privacy regulations.
Sensitive personal information can appear in large-scale pre-training corpora for large language models (LLMs). Detecting and filtering such information is therefore essential to ensure compliance with privacy regulations and prevent unintended information leakage. However, in contrast to English and other languages, research into sensitive personal information has been limited in the Japanese language. In this study, we focus on sensitive personal data defined as special care-required personal information (SCPI) under Japan's Act on the Protection of Personal Information (APPI). We construct an SCPI dataset using LLM-based annotation and train machine learning models to rapidly detect SCPI in text. As a result, our SCPI classifier can effectively identify information related to SCPI. This study is the first to explore SCPI detection in Japanese text corpora, highlighting the challenges of accurate detection.
