Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces SHARE, a family of causal language models pretrained specifically on social sciences and humanities (SSH) texts. They demonstrate that SHARE models achieve performance comparable to general-purpose models like Phi-4 on a custom SSH Cloze benchmark, despite using significantly fewer training tokens. The authors also present MIRROR, a novel user interface designed to facilitate critical engagement with text inputs from SSH disciplines by prototyping a generative AI interface that does not generate any text.
Social science and humanities researchers can now leverage language models trained on their own data that rival general-purpose models in performance, but with 100x less training data.
This intermediate technical report introduces the SHARE family of base models and the MIRROR user interface. The SHARE models are the first causal language models fully pretrained by and for the social sciences and humanities (SSH). Their performance in modelling SSH texts is close to that of general purpose models (Phi-4) which use 100 times more tokens, as shown by our custom SSH Cloze benchmark. The MIRROR user interface is designed for reviewing text inputs from the SSH disciplines while preserving critical engagement. By prototyping a generative AI interface that does not generate any text, we propose a way to harness the capabilities of the SHARE models without compromising the integrity of SSH principles and norms.