Search papers, labs, and topics across Lattice.
This paper introduces a novel generalization bound for deep learning models that improves upon existing robustness-based bounds by accounting for the variation of robustness across different sub-regions of the input space. By scaling the robustness term based on the number of stable and unstable samples, the authors achieve tighter upper bounds on true error rates, which are crucial for evaluating models in safety-critical applications. Experiments on ImageNet demonstrate that their approach yields consistently non-vacuous bounds that closely align with empirical performance, outperforming existing methods.
Tighter generalization bounds that adapt to local input variations could redefine how we evaluate deep learning models in safety-critical contexts.
Generalization is a critical property of data-driven models, particularly deep learning models deployed in safety-critical applications. Robustness-based generalization bounds have gained attention as a principled way to link robustness properties to generalization performance, often in a data-dependent manner. However, most existing bounds suffer from vacuousness in practical settings, yielding loose upper bounds that greatly exceed the actual error rates and limiting their usefulness for real-world evaluation. While this issue is often attributed to the uncertainty term, a substantial part of the problem originates from the robustness term itself, particularly for the 0-1 loss. Existing approaches typically treat the robustness term as a global measure, ignoring its variation across different sub-regions of the input space. In this work, we propose a generalization bound that addresses this limitation by scaling the robustness term according to the number of stable and unstable samples within each sub-region. Our bounds incorporate both data- and model-dependent factors while maintaining practical relevance (yielding tighter upper bounds on true error). Experiments on models trained on the ImageNet dataset show that our bounds remain consistently non-vacuous and achieve the tightest estimates among existing methods, closely aligning with empirical performance across a range of robust deep neural networks.
