Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the effectiveness of various adaptation strategies—definitions, examples, and fine-tuning—for climate disclosure classification when faced with source shifts across different types of corporate disclosures. The authors evaluate eleven LLMs on two corpora that share label spaces but differ in source characteristics, revealing that while all strategies yield positive cross-source gains, the most effective in-source methods do not necessarily translate well to cross-source scenarios. Notably, simpler strategies, such as using definitions that match the target text's granularity, consistently outperform more complex methods under source shift conditions, highlighting a critical insight into model robustness.
Simpler adaptation strategies often outperform complex ones when shifting sources, revealing a surprising vulnerability in advanced methods for climate disclosure classification.
Climate disclosure classification is a fundamental task for analysing corporate climate disclosures, yet such disclosures appear in many different sources -- annual reports, press releases, and earnings calls -- that differ in length, purpose, and writing style. Existing evaluations are mostly conducted within a single source, leaving open whether common LLM adaptation strategies remain effective under source shift. We reframe climate disclosure classification as a cross-source adaptation problem and study three widely used adaptation strategies -- definitions, examples, and fine-tuning -- across eleven open- and closed-source LLMs, using two corpora that share the same label space but come from different sources. We find that all strategies bring positive cross-source gains on average, but the strongest in-source strategies are not the strongest cross-source ones: similarity-based retrieval and LoRA fine-tuning gain most in-source but lose most of that advantage under source shift; randomly selected few-shot examples, a weaker in-source baseline, retain their advantage more reliably; definitions transfer most consistently, though only when their granularity matches the target text. Across these strategies, when the source changes, simpler is often safer.