Search papers, labs, and topics across Lattice.
This study introduces ChronoLens, a novel framework that leverages frozen multilingual language models and feature-aligned crosscoders to analyze historical language change across morphology, syntax, semantics, and pragmatics within a unified analytical space. By applying this framework to a vast corpus of 44.98 million documents, the authors demonstrate that language change is a structured, multidimensional process, revealing that while linguistic levels evolve comparably within a language, the timing and nature of changes vary significantly across languages. The findings indicate that meaningful cross-linguistic comparisons necessitate measuring both the magnitude and direction of change, challenging traditional views on language evolution.
Historical language change is not only multidimensional but also varies significantly in timing and direction across languages, challenging existing paradigms in linguistic research.
Historical language change affects morphology, syntax, semantics, and pragmatics, yet computational studies typically examine these levels with incompatible representations and therefore cannot determine whether they evolve together across languages. We address this problem by asking how the magnitude and direction of change vary across linguistic levels, languages, and historical periods within a single analytical space. We introduce ChronoLens, a framework that combines frozen multilingual language models, feature-aligned crosscoders, and post-hoc linguistic interventions, and apply it to 44.98 million documents and approximately 17.2 billion tokens from five parliamentary traditions spanning 1803--2026. The resulting sparse representations agree substantially more strongly with linguistic statistics than dense embeddings or a pooled sparse autoencoder ($\rho=0.72$ versus $0.29$ and $0.28$), and reveal that morphology, syntax, semantics, and pragmatics generally change by comparable amounts within a language, while languages differ markedly in when, how far, and in which direction they change. These findings show that historical language change is a structured, multidimensional process: similar magnitudes can conceal different trajectories, and meaningful cross-linguistic comparison requires measuring both distance and direction.
