Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a unified framework for task-aware imputation, treating missing entries as variables within a task-conditioned optimization problem to address train-test mismatches in missingness. Evaluating on 98 tabular datasets, the study demonstrates that traditional imputation's reconstruction error is a weak predictor of downstream utility, highlighting the necessity of task-aware methods. The proposed approach significantly improves robustness under train-test mismatches, achieving up to 80% win rates in challenging scenarios where classical methods falter.
Standard imputation methods fail to predict downstream utility, but task-aware imputation recovers complete-data performance in up to 80% of challenging train-test mismatch scenarios.
Missing data is a pervasive challenge in machine learning, often degrading predictive performance and complicating model deployment. Most existing approaches treat imputation as a preprocessing step independent of the downstream task, a separation that becomes problematic under train-test mismatches in missingness mechanisms or rates. We introduce a unified framework that treats missing entries as variables in a task-conditioned optimization problem. We instantiate this framework in two settings: an amortized approach for scenarios with missing data at both training and test time, and a latent optimization approach for settings where only training data is incomplete. The evaluation is conducted on 98 tabular datasets, and robustness under train-test mismatches is assessed on 36 datasets. Results reveal that reconstruction error constitutes a poor proxy for predictive utility (Spearman rho approximately 0.16 to 0.32), and that task-aware imputation becomes critical in scenarios where classical methods fail to recover complete-data performance, achieving win rates of up to 80% in challenging train-test mismatch scenarios.