Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
To alleviate the manual bottleneck of crosslinguistic comparison, the authors developed AUTOTYPOLOGIST, a ReAct-style LLM agent that retrieves sections from reference grammars, parses interlinear glossed text (IGT), and iteratively tests linguistic hypotheses. Automating typological analysis addresses a longstanding challenge in scaling grounded, inspectable linguistic evaluation beyond high-resource languages. Evaluated on 25 reference grammars across typological feature coding and hypothesis testing, the agent effectively leverages grammar prose to identify crosslinguistic patterns and counterexamples, but exhibits notable performance degradation when restricted strictly to IGT.
LLMs can reliably parse descriptive grammar prose to validate linguistic universals and surface counterexamples, but fall flat when forced to induce typological features directly from interlinear glossed text.
Linguistic typology relies on expert analysis of reference grammars across languages, making large-scale crosslinguistic comparison labor-intensive and unscalable. We introduce AUTOTYPOLOGIST, an LLM agent for evidence-grounded typological analysis over reference grammars. The agent is capable of retrieving relevant grammar sections, analyzing interlinear glossed text (IGT), and iteratively reasoning over typological hypotheses using a ReAct-style workflow. We evaluate the system on TYPOLOGICAL FEATURE CODING against expert annotations and TYPOLOGICAL HYPOTHESIS TESTING with typological universals using 25 open-source reference grammars. Operating under different information constraints in TYPOLOGICAL FEATURE CODING, the agent can synthesize information from reference grammar prose but still faces challenges with only IGTs in the target language. In TYPOLOGICAL HYPOTHESIS TESTING, the agent can synthesize crosslinguistic evidence and identify both supporting cases and counterexamples. These findings suggest that LLM agents can support scalable and inspectable typological analysis, while still requiring expert validation.