Search papers, labs, and topics across Lattice.
This paper introduces EVIL-Detect, a multi-signal ensemble framework designed to accurately detect LLM-generated text in complex Chinese scenarios that include human-written and LLM-refined text. By employing a combination of edit-extent regression, zero-shot likelihood-contrast signals, and lexical statistics, the system enhances detection robustness against out-of-distribution shifts. The approach achieved a macro-F1 score of 0.8888, securing the top position in the official evaluation for NLPCC 2026 Shared Task 6.
EVIL-Detect outperforms existing methods by achieving a macro-F1 score of 0.8888 in detecting LLM-generated text, even under challenging conditions.
The rapid development of large language models (LLMs) has increased the need for reliable detection of LLM-generated text, especially in realistic Chinese scenarios involving human-written text (HWT), LLM-generated text (LGT), and LLM-refined text (HLT). This paper presents EVIL-Detect, a multi-signal ensemble framework with conflict-aware fusion for NLPCC 2026 Shared Task 6. The system integrates edit-extent regression, zero-shot likelihood-contrast signals, lexical statistics, and conservative text rules. With calibrated decision boundaries and conflict-aware integration, our system improves robustness under strong out-of-distribution shifts, achieving a macro-F1 score of 0.8888 and ranking first in the official evaluation. Our code is available at https://github.com/bbbbhrrrr/evildetect.
