Search papers, labs, and topics across Lattice.
This paper introduces ATLAS, an active learning framework designed to automate the discovery of interpretable behavioral models in cognitive science by generating mechanistic hypotheses and optimizing experimental designs. By employing a diverse ensemble of sparse neural networks, ATLAS iteratively refines its approach to distinguish between competing hypotheses through strategically crafted experiments. The framework demonstrates a 5-10x improvement in sample efficiency compared to random experimentation, validating its effectiveness against expert-designed experiments in recovering reinforcement learning agents from behavioral data.
ATLAS achieves a staggering 5-10x increase in sample efficiency for discovering interpretable behavioral models, revolutionizing experimental design in cognitive science.
Advancing scientific understanding through mechanistic modeling requires posing the right experimental questions to yield maximally informative data. To automate this pursuit within cognitive science, we introduce ATLAS (Active Theory Learning for Automated Science), an active learning framework for the data-driven discovery of interpretable behavioral models. ATLAS iterates between generating mechanistic hypotheses--instantiated as a diverse ensemble of sparse neural networks (Disentangled RNNs)--and designing experiments that optimally distinguish between them. We test this approach on the problem of recovering reinforcement learning agents from their behavior in bandit tasks. ATLAS designs varied sequences of qualitatively novel experiments with temporal structure tailored to underlying agent characteristics. The models trained on these experiments are evaluated against a comprehensive set of metrics for mechanistic modeling that capture behavioral, structural, and computational similarity. ATLAS achieves a 5-10x improvement in sample efficiency across all metrics compared to random experimentation, and its performance is further validated against expert-designed experiments derived from literature. These in silico results showcase ATLAS's potential to accelerate human-interpretable insights in cognitive science and other domains where scientific inquiry relies on discovering mechanistic models.
DeepMind