Search papers, labs, and topics across Lattice.
This paper addresses the challenge of generating a scalable taxonomy of security and privacy concerns from mobile app reviews, which are abundant yet underutilized due to existing hand-crafted methods. By filtering over 600,000 reviews for relevant content and employing a novel pipeline called TaxoScale, the authors successfully automate taxonomy construction using Recursive Hierarchical Clustering and LLM-based node naming. The results show that TaxoScale surpasses traditional automatic taxonomy methods across multiple metrics, revealing new branches of concerns not previously identified.
TaxoScale reveals novel security and privacy concerns from over 600,000 mobile app reviews, outperforming traditional methods in taxonomy generation.
Mobile app reviews are a rich, continuously renewing source of how users experience privacy and security, yet existing taxonomies of these concerns are hand-crafted and cannot keep pace with the evolving nature of the data. Automating taxonomy construction is the natural response, but scalability is the core challenge: current LLM- and clustering-based methods are developed for scientific corpora of a few thousand documents and do not extend to app review collections numbering in the hundreds of thousands. We address this gap in two ways. First, we filter app reviews for privacy- and security-related content, yielding a comprehensive corpus of over 600K reviews. Second, we introduce TaxoScale, a pipeline that handles taxonomy construction at this scale by extending an expert-defined taxonomy via Recursive Hierarchical Clustering and LLM-based node naming. TaxoScale outperforms strong automatic-taxonomy baselines on path, level, coverage, and novelty metrics, and discovers novel branches absent from prior taxonomies.
