Search papers, labs, and topics across Lattice.
This study benchmarks the impact of code-mixed product reviews on recommendation performance in the context of Daraz Bangladesh, focusing on reviews written in Bengali, English, and Banglish. By evaluating six model families through a per-user chronological leave-last-out protocol and addressing long-tail sparsity with systematic k-core threshold ablation, the authors find that Item-based Collaborative Filtering remains robust, while Implicit Matrix Factorization suffers under low-density conditions. Notably, the analysis reveals that the fragmentation of the Banglish vocabulary significantly degrades recommendation quality, with a 46.8% reduction in NDCG@10 compared to Bengali-script users, highlighting the challenges of transliteration inconsistency.
Code-mixed reviews can degrade recommendation performance by nearly 47%, revealing critical vulnerabilities in e-commerce systems that rely on user-generated content.
Bangladeshi e-commerce platforms host millions of product reviews written in Bengali Unicode, English, and Banglish, where Bengali is phonetically transcribed in Latin script. However, the impact of code-mixed reviews on recommendation performance remains largely unexplored. We present the first such benchmarking on product reviews from Daraz Bangladesh, evaluating six model families under a per-user chronological leave-last-out protocol. To address the severe long-tail sparsity of the dataset, where 59.3% of users have exactly one interaction, we conduct a systematic k-core threshold ablation across five density configurations. The results reveal that Item-based Collaborative Filtering remains stable across settings, Implicit Matrix Factorization degrades sharply with decreasing density, and Explicit Matrix Factorization uniquely improves at higher thresholds. To characterize the impact of code-mixing on recommendation quality, we perform a language-stratified evaluation of content-based filtering using character n-gram TF-IDF profiles. The results provide empirical evidence that fragmentation of the Banglish vocabulary reduces NDCG@10 by 46.8% relative to Bengali-script users, a degradation traceable to transliteration inconsistency across surface forms. This work establishes a reproducible evaluation foundation for recommendation research in code-mixed, low-resource e-commerce settings. The code is publicly available at https://github.com/os-car-war-thy/daraz-recsys.