Search papers, labs, and topics across Lattice.
This paper explores the feasibility of dependency parsing for non-human sequences, challenging the assumption that evaluation is impossible without a gold standard. By leveraging recent advances in network science, the authors show that the rapid decay of sequence length distribution in non-human primate vocalizations allows for a high proportion of correct edges to be retrieved by unsupervised parsers. This finding indicates that while evaluating parsing accuracy in human languages is complex, it is feasible for non-human primates, opening new avenues for linguistic research across species.
Evaluating unsupervised dependency parsing in non-human primates is not only possible but reveals a stark contrast to the challenges faced in human language analysis.
Dependency parsing consists of finding a tree representation for a sequence. Unsupervised dependency parsing aims to develop parsing methods without a gold standard during model training. In human languages, an unsupervised parser can be evaluated because some gold standard is usually available or can be created. For other species, a gold standard is unknown. Thus one may conclude that it is impossible to determine the accuracy of an unsupervised parser and, consequently, dependency parsing is unfeasible in other species. However, here we apply recent advances in network science to demonstrate that the proportion of correct edges retrieved by a parser must be high for the sequences of vocalizations or gestures that non-human primates produce due to the fast decay of the sequence length distribution. In contrast, human language sequences lack that property. Therefore, evaluation without a gold standard is feasible in non-human primates but a hard problem in humans.