Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study conducts a comparative evaluation of BERT, RoBERTa, and CodeBERT for detecting software vulnerabilities in multiple programming languages, specifically HTML, Python, JavaScript, and PHP, utilizing the CVEFixes dataset. By employing language-wise three-fold stratified cross-validation, the authors reveal significant performance variations across languages, highlighting the necessity for tailored transformer models in multilingual contexts. The findings underscore that existing models may not adequately address the complexities of vulnerability detection in diverse programming environments.
Multilingual software vulnerability detection reveals stark performance disparities, emphasizing the need for more language-aware transformer models.
Software vulnerability detection is increasingly important as modern applications combine multiple programming languages. This paper presents an early comparative evaluation of BERT, RoBERTa, and CodeBERT for binary vulnerability detection across HTML, Python, JavaScript, and PHP using the CVEFixes dataset and language-wise three-fold stratified cross-validation. The results show clear performance differences across languages, indicating that multilingual vulnerability detection requires more language-aware and robust transformer-based modelling strategies.