Rüdiger Urbanke

Cross-validation's accuracy plummets when the number of folds increases with the sample size, hitting a fundamental $Ω(\sqrt{k}/n)$ lower bound on mean-squared error, even for the simple majority algorithm.