Search papers, labs, and topics across Lattice.
This paper addresses the challenge of classifying environmental mitigation obligations in hydropower licensing documents, a task complicated by severe label scarcity in a 135-category taxonomy. By introducing a Retrieval-Augmented Generation (RAG) pipeline that leverages retrieved category definitions, the authors enable zero-shot generalization, significantly improving classification performance. The hybrid approach, which combines BERT detection with RAG classification, achieves a Micro F1 score of 0.524, surpassing both the BERT-only and RAG-only methods in performance across all training-support scenarios.
Zero-shot generalization in environmental classification is now achievable, with a hybrid model outperforming traditional methods by effectively leveraging retrieval techniques.
Identifying and classifying environmental mitigation obligations in Federal Energy Regulatory Commission hydropower licensing documents is a labor-intensive task requiring deep domain expertise. We formulate this as a multi-label classification problem over a structured 135-category taxonomy and address the central challenge of severe label scarcity: 40 of 135 categories have no training examples, and 26 have fewer than five. A supervised Bidirectional Encoder Representations from Transformers (BERT)-based pipeline, while effective on well-represented categories, achieves F1 of zero on unseen classes regardless of augmentation strategy. We introduce a Retrieval-Augmented Generation (RAG) pipeline that conditions classification on retrieved category definitions, enabling zero-shot generalization across the full label space. We further propose a hybrid system that combines BERT detection with RAG classification, exploiting the high recall of fine-tuned detection and the zero-shot coverage of retrieval-augmented reasoning. Evaluated on the full set of 2017 license documents (5,860 paragraphs, 135 categories), the hybrid achieves a Micro F1 of 0.524, outperforming the BERT-only pipeline (0.477) and the RAG-only pipeline (0.416) across all training-support buckets.
