Search papers, labs, and topics across Lattice.
This study evaluates seven categorical encoding methods for high-cardinality fraud detection using the IEEE-CIS fraud benchmark dataset, employing a stratified 5-fold cross-validation approach. The results reveal that entity embeddings yield the highest AUC-ROC score (0.9612), closely followed by CatBoost (0.9602), while traditional methods like tier group encoding and target encoding performed significantly worse. Notably, the analysis indicates that the performance advantage of embeddings stems from their ability to represent multiple columns jointly, highlighting their effectiveness in complex fraud detection scenarios.
Entity embeddings outperform traditional encoding methods in high-cardinality fraud detection, achieving a record AUC-ROC score that could redefine best practices in the field.
A total of seven categorical encoding methods were tested on the IEEE-CIS fraud benchmark dataset (590,540 records, 3.5% positives, 8 high-cardinality columns). The encoders were evaluated using a stratified 5-fold cross-validation (CV) with three repetitions. Five of the encoders had identical frozen LightGBM learners in the downstream phase, allowing for controlled comparisons of their performance to each other. CatBoost and TabNet were included as comparisons across paradigms using different learners. The entity embeddings produced the highest AUC-ROC (0.9612), with a statistically significant tie with that of CatBoost (0.9602) and statistically superior to tier group encoding (0.9548), whereas target encoding was only 0.0023 worse than tier group encoding and the auditor-friendly tier boundaries were maintained. Off-the-shelf TabNet did not outperform tree-based pipelines and collapsed under data scarcity. On AUC-PR, CatBoost leads (0.822 vs. 0.793); no encoder dominated both metrics. Per-column analysis confirmed the embedding advantage arises from joint multi-column representation.
