Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors formulate a distributionally robust optimization framework that learns robustness hyperparameters directly from held-out data via a bilevel optimization objective featuring nested minimax problems at both levels. This approach bypasses expensive and brittle heuristic grid searches to address simultaneous intra-group and inter-group distribution shifts in both group-labeled and group-agnostic settings. Their theoretical sample complexity bounds match those of exhaustive grid search while empirically achieving superior computational efficiency and out-of-distribution generalization.
Manual tuning of DRO uncertainty sets can be completely automated without statistical penalty, matching exhaustive grid-search sample complexity via nested minimax optimization.
We propose a distributionally robust learning framework where parameters defining the robustness mechanism are learned from held-out data instead of extensively tuned. Using bilevel optimization with both upper and lower level minimax problems, we create two instances of our framework to tackle setups with and without group labels in the training set. Theoretically, we provide sample complexity analysis for our robustness mechanism learning paradigm, showing that it achieves generalization guarantees comparable to exhaustive grid search while being more computationally efficient. Empirically, we evaluate our framework under a challenging setup when both intra-group and inter-group test distribution shifts occur at the same time, thereby demonstrating the efficacy and scalability of our method.