Search papers, labs, and topics across Lattice.
This paper introduces a robust method for sequential conditional independence testing that addresses the fragility of existing tests reliant on exact Model-X conditional distributions. By employing a testing-by-betting framework with an adaptively optimized Kernel Conditional Independence statistic, the authors significantly mitigate Type I error inflation while maintaining high statistical power. The proposed approach demonstrates superior performance on both synthetic benchmarks and real-world fairness tasks compared to traditional sequential Model-X methods.
Type I error inflation in conditional independence testing can be drastically reduced without sacrificing power, thanks to a novel betting-based approach.
Testing conditional independence is fundamental yet intrinsically difficult: without additional assumptions, Type I error control is impossible in general. The "Model-X'' paradigm addresses this difficulty by assuming exact knowledge of a relevant conditional distribution. While small deviations from this assumption can sometimes be tolerated in classical one-shot testing, existing sequential conditional independence tests typically require the Model-X conditional to be known exactly, making them fragile when it must instead be estimated. We propose a new approach that is substantially more robust to such estimation error. Our method applies testing-by-betting to an adaptively optimized Kernel Conditional Independence statistic, together with a normalization scheme and a truncate-and-shift calibration strategy. These modifications greatly reduce Type I error inflation while preserving high power across high-dimensional synthetic benchmarks and real-world fairness tasks, outperforming existing sequential Model-X approaches. Code is available at https://github.com/he-zh/SKCI.
