Search papers, labs, and topics across Lattice.
This paper introduces a weakly supervised framework for Hierarchical Text Classification (HTC) that leverages large language models (LLMs) to enhance label hierarchy understanding and address class imbalance. By semantically enriching label hierarchies through keyword generation and corpus mining, the framework improves the model's grasp of label structures, while a Gaussian mixture model is utilized for confidence-based resampling of LLM-generated pseudo-samples. Experimental results indicate that this approach significantly boosts classification performance on challenging fine-grained and imbalanced datasets, demonstrating its effectiveness in overcoming traditional limitations in HTC tasks.
LLMs can be harnessed to transform weakly supervised hierarchical text classification, boosting performance on imbalanced datasets through innovative data augmentation techniques.
Hierarchical Text Classification (HTC), as a critical text mining task, faces challenges such as complex label hierarchies and class imbalance. Existing methods based on large language models (LLMs) struggle to be efficiently applied to this task due to issues like lengthy prompts and loss of label structural information. To address these limitations, this paper proposes a weakly supervised HTC framework enhanced by LLM-based data augmentation. The framework first enriches the label hierarchy semantically through keyword generation and corpus mining, thereby enhancing the model鈥檚 understanding of labels. Subsequently, it guides the LLM to generate pseudo-samples to mitigate the long-tail problem, and employs a Gaussian mixture model for confidence-based resampling to optimize the quality of generated data. Experimental results demonstrate that the proposed method effectively improves the reliability of LLM-generated pseudo-labels and significantly enhances classification performance on fine-grained and imbalanced datasets.
