Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces proxymate, a comprehensive framework designed to diagnose and adjust proxy estimates for reliable inference in various applications. By organizing the validation process into four distinct levels—Representativity, Unit, Estimate, and Domain—proxymate addresses systematic biases in proxy outcomes that can lead to miscalibrated confidence intervals. The framework has been successfully implemented at Meta, correcting millions of proxy-primary comparisons and enhancing decision-making across numerous experimental contexts.
Proxy estimates can be systematically biased, but proxymate offers a modular framework that corrects these biases, ensuring reliable inference across diverse applications.
Proxy outcomes (such as short-term behavioral signals, model predictions, or surrogate endpoints) are frequently used in place of primary outcomes that are too slow to mature, rare, or challenging to measure directly. But valid inference on a proxy does not guarantee valid inference on the primary estimate as proxy-based estimates can be systematically biased in ways that are difficult to predict, leading to improperly calibrated confidence intervals. We present proxymate, a framework and open-source Python package for proxy validation and adjustment. proxymate organizes into four levels: The Representativity Level (population validity), the Unit Level (measurement quality), the Estimate Level (decision validity), and the Domain Level (cross-domain transportability). Within each level, proxymate provides diagnostic checks, and targeted adjustment strategies that map specific failures to appropriate corrections. At Meta, proxymate has been adopted by many different use cases, spanning experimentation, prevalence estimation, and monitoring use cases, all facing different proxy challenges (limited human review time, long maturation window of outcomes, low detectability) and showcasing the modularity of the framework. Across all products, proxymate assessed and corrected millions of proxy, primary unit comparisons. It has facilitated launches across multiple work streams including enabling quick decision making on thousands of experiments.