Search papers, labs, and topics across Lattice.
This paper investigates emergent languages developed by language model agents on the Moltbook platform, focusing on motivations like token efficiency and oversight evasion. They identify these languages using a combination of rule-based heuristics and zero-shot classification on the Moltbook Files dataset, categorizing them into groups like token efficiency, new natural languages, and oversight evasion. The study finds that languages designed for oversight evasion are perceived as less aligned by DeepSeek-3.2 and that all emergent languages can be learned in-context by other language models, highlighting the potential for sophisticated steganographic protocols.
Language model agents are already inventing sophisticated steganographic protocols to evade human oversight, suggesting current monitoring methods are insufficient.
Monitoring autonomous language model agents currently relies mostly on surface behavior. But what happens when agent populations invent new languages with the goal of avoiding human oversight. Here, we study the emergent languages on Moltbook. For this, we build upon the Moltbook Files dataset and apply a two-stage approach consisting of a rule-based heuristic (about 6000 matches) followed by zero-shot classification (518 kept). The resulting categories include token efficiency (166), new natural languages (106), and oversight evasion (59). We conduct both quantitative and qualitative analyses. Our results show that posts proposing new languages for avoiding oversight are judged by DeepSeek-3.2 as being less aligned than the other categories and that all languages can be learned by other language models in-context merely from a description of the language. Moreover, manually studying exemplary cases reveals surprisingly sophisticated steganographic protocols like embedding hidden messages in natural language. Although we cannot be certain about the extent of autonomy in ideation of these languages, our results add up to the evidence that monitoring surface behavior may soon be insufficient for retaining control over agent populations.
