Search papers, labs, and topics across Lattice.
This paper introduces LOGOS, a generative language model designed to unify various tasks in the natural sciences through a shared scientific grammar and autoregressive framework. By encoding scientific objects and their spatial interactions as token sequences, LOGOS captures complex structural relationships without relying on explicit geometric representations. The model demonstrates superior performance across diverse scientific tasks compared to domain-specific baselines, suggesting a promising direction for integrating large language models into scientific research.
LOGOS shows that a single generative model can outperform specialized systems across multiple scientific domains, challenging the need for separate technical stacks in AI for Science.
In this report, we present LOGOS (Language Of Generative Objects in Science), a scientific generative language model that unifies heterogeneous tasks across the natural sciences within a single autoregressive framework based on a shared scientific grammar. It encodes diverse scientific objects and their spatial interactions as token sequences over a common vocabulary. By representing spatial contact and constraint patterns as discrete tokens, the model captures complex structural interactions in a purely sequential manner, without relying on explicit coordinates or geometric neural networks. This unified representation enables a wide range of downstream tasks to be formulated consistently as next-token prediction in the same grammar space, creating strong alignment between continued multi-domain pre-training and downstream objectives. Across diverse tasks, LOGOS consistently matches or outperforms domain-specific baselines, providing preliminary evidence for the feasibility of "one model fits all" in the natural sciences. We train LOGOS models at different scales (1B, 3B, and 8B parameters) and find a consistent positive correlation between model size and performance. This suggests that the future of AI for Science (AI4S) may not lie in building an independent technical stack that is separated from large language models (LLMs). Instead, it may depend on deeply aligning scientific foundation models with LLMs through shared architectures, shared training paradigms, and shared inference infrastructure, so that LLMs can truly become a new entry point for AI4S. We release the model weights and associated resources to facilitate further research.
DAMO