Search papers, labs, and topics across Lattice.
This paper investigates whether language models (LMs) trained on synthetic corpora exhibit typological preferences for differential argument marking (DAM) systems, focusing on markedness direction and object preference. They trained GPT-2 models on 18 synthetic corpora implementing different DAM systems and evaluated their generalization using minimal pairs. The results show that LMs reliably exhibit human-like preferences for natural markedness direction but fail to reproduce the strong object preference observed in human languages.
LMs can learn some human-like linguistic biases from synthetic data, but surprisingly fail to reproduce the strong object preference seen in differential argument marking across human languages.
Recent work has shown that language models (LMs) trained on synthetic corpora can exhibit typological preferences that resemble cross-linguistic regularities in human languages, particularly for syntactic phenomena such as word order. In this paper, we extend this paradigm to differential argument marking (DAM), a semantic licensing system in which morphological marking depends on semantic prominence. Using a controlled synthetic learning method, we train GPT-2 models on 18 corpora implementing distinct DAM systems and evaluate their generalization using minimal pairs. Our results reveal a dissociation between two typological dimensions of DAM. Models reliably exhibit human-like preferences for natural markedness direction, favoring systems in which overt marking targets semantically atypical arguments. In contrast, models do not reproduce the strong object preference in human languages, in which overt marking in DAM more often targets objects rather than subjects. These findings suggest that different typological tendencies may arise from distinct underlying sources.
UW