Search papers, labs, and topics across Lattice.
This study investigates the relationship between model compression and generalization in machine learning research agents, particularly focusing on LLMs. By employing two information bottlenecks鈥攐utput compression through short prompts and input compression via one-bit feedback鈥攖he authors demonstrate that high-performance models can be effectively reproduced without overfitting, even when validation set overfitting is induced. The findings suggest that successful ML strategies tend to occupy a low-complexity region in the strategy space, challenging conventional assumptions about the risks of overfitting in benchmark-driven ML.
High-performance ML models can be reproduced with minimal information, revealing that they thrive in low-complexity regions and defy traditional overfitting concerns.
Reusing a held-out benchmark adaptively should, in principle, invite overfitting. Yet benchmark-driven machine learning (ML) has produced surprisingly little overfitting in practice. An attractive hypothesis is that successful ML strategies are highly compressible. We study this in the setting of LLM-driven research agents, where the hypothesis becomes directly testable via two complementary information bottlenecks. In \emph{output compression}, an exploration agent adaptively searches for high-performance models using a validation set, and we test whether a fresh ``reproducer agent'' can reproduce its performance given only an extremely short prompt and the training data. In \emph{input compression}, the explorer receives only one-bit feedback indicating whether each submitted model improves on the running best. Across 8 datasets spanning tabular classification, vision, language modeling, diffusion modeling, and reward modeling, we find that these bottlenecks have little effect on performance: short prompts and compressible feedback are sufficient to reproduce and find high-performance models. The hypothesis is falsifiable: when we deliberately induce validation-set overfitting, the results fail to reproduce with short prompts. Taken together, our results support a description-length explanation for the lack of overfitting in benchmark-driven ML: successful strategies occupy a low-complexity region of strategy space.
Amazon Science
CMU ML