Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a geometric methodology using a Topological Auditor to identify and mitigate shortcut learning in neural networks, which causes biases and poor generalization. They show a "Capacity Phase Transition" where pruning linear shortcuts forces the network to learn more robust, ethical representations by increasing geometric capacity. Experiments demonstrate that their approach outperforms L1 regularization and reduces counterfactual gender vulnerability more effectively than existing methods like Just Train Twice.
Pruning linear shortcuts in neural networks can force them to learn fairer, more robust representations by leveraging higher geometric capacity.
Deep Neural Networks are highly susceptible to shortcut learning, frequently memorizing low-dimensional spurious correlations instead of underlying causal mechanisms. This phenomenon not only degrades out-of-distribution robustness but also induces severe demographic biases in sensitive applications. In this paper, we propose a geometric \textit{a priori} methodology to mitigate shortcut learning. By deploying a zero-hidden-layer ($N=1$) Topological Auditor, we mathematically isolate features that monopolize the gradient without human intervention. We empirically demonstrate a Capacity Phase Transition: once linear shortcuts are pruned, networks are forced to utilize higher geometric capacity ($N \geq 16$) to curve the decision boundary and learn ethical representations. Our approach outperforms L1 Regularization -- which collapses into demographic bias -- and operates at a fraction of the computational cost of post-hoc methods like Just Train Twice (JTT), successfully reducing counterfactual gender vulnerability from 21.18\% to 7.66\%.