Search papers, labs, and topics across Lattice.
This paper presents a hybrid NLP pipeline that integrates unsupervised clustering and supervised classification to detect accusatory language in public procurement comments from Ecuador's Sistema Oficial de Contrataci贸n P煤blica. By employing domain-specific Word2Vec embeddings alongside Gaussian Mixture Models for clustering and a Random Forest classifier for supervision, the authors achieve high precision and recall in identifying irregular procurement processes. The results highlight the effectiveness of lightweight NLP architectures in enhancing transparency and risk identification in public procurement systems, even in the face of class imbalance challenges.
Lightweight NLP models can uncover hidden patterns in public procurement, revealing potential irregularities with impressive accuracy.
Public procurement involves the allocation of substantial financial resources; therefore, continuous oversight through audits, controls, and monitoring mechanisms is essential. However, stakeholder comments and publicly available government data are often underutilized, despite their potential to reveal procedural irregularities. To address this gap, this paper analyzes metadata from Ecuador's Sistema Oficial de Contrataci\'on P\'ublica (SOCE, Official Public Procurement System), with particular emphasis on participant comments generated during the pre-contractual phase. We propose a hybrid modeling framework that integrates unsupervised clustering and supervised classification within a natural language processing (NLP) pipeline to uncover latent patterns and detect potentially irregular procurement processes. Semantic embeddings are generated using Word2Vec, LLaMA, and RoBERTa, followed by Gaussian Mixture Models (GMMs) for unsupervised clustering. A supervised classification stage is then applied to identify accusatory or whistleblowing-style comments. Experimental results show that the combination of domain-trained Word2Vec embeddings, GMM-based clustering, and a Random Forest classifier achieves high precision and recall, even under severe class imbalance. These findings demonstrate that lightweight, domain-adapted NLP architectures can effectively support risk identification and enhance transparency in public procurement systems without requiring large-scale computational infrastructure.
