Search papers, labs, and topics across Lattice.
This study employs training-data attribution to uncover the sources of social and STEM reasoning capabilities in the OLMo3-7B language model, revealing distinct corpus regions that support each reasoning type. By aggregating influence scores across a comprehensive taxonomy and contrasting performance on reasoning versus knowledge benchmarks, the authors find that social reasoning relies on qualitatively different training data compared to STEM reasoning. The findings are validated through targeted machine unlearning, demonstrating that removing high-attribution topic bins significantly impacts model performance on social reasoning tasks.
Social reasoning in language models is rooted in distinct training data, with targeted unlearning revealing its vulnerability to data removal.
We use training-data attribution as an interpretable tool for capability discovery, mapping which regions of the pretraining corpus support social-reasoning versus STEM-reasoning in OLMo3-7B. Training-data attribution measures how strongly each training document influences a model's predictions on a benchmark, but document-level scores are too noisy to identify which corpus regions support which capabilities, and prior work has emphasized factual knowledge rather than reasoning. We compute gradient-based attribution (TrackStar via Bergson) over a working set drawn from the de-duplicated Dolma3 mix, aggregate influence across WebOrganizer's 24-format x 24-topic taxonomy (576 bins), and contrast benchmark pairs in a 2x2 design that varies domain (social vs. STEM) and capability type (reasoning vs. knowledge): SocialIQA and MMLU Social Sciences against ARC-Challenge and MMLU STEM. Social and STEM reasoning draw on qualitatively distinct corpus regions, and the contrast is sharper at the reasoning level than at the knowledge level. Targeted machine unlearning provides partial causal validation: forgetting high-attribution topic bins (e.g., Literature for SocialIQA) degrades the aligned benchmark more than within-bin random baselines, and we open-source all code, sampling manifests, the bin-level influence matrix, and unlearning checkpoints.
