Search papers, labs, and topics across Lattice.
This paper introduces Geometric Gradient Rectification (GGR), a novel framework for open-set semi-supervised learning that addresses the limitations of existing methods by focusing on gradient-level control rather than sample selection. By anchoring the supervised gradient and projecting conflicting auxiliary gradients onto an admissible region in gradient space, GGR ensures that updates remain non-opposing while retaining useful representation signals. Experimental results on CIFAR and ImageNet demonstrate that GGR significantly enhances the performance of representative open-set semi-supervised learning baselines, improving both closed-set generalization and open-set robustness.
GGR transforms the landscape of open-set semi-supervised learning by ensuring that auxiliary gradients enhance rather than conflict with supervised updates.
Open-set semi-supervised learning aims to leverage unlabeled data that may contain out-of-distribution outliers while maintaining performance on in-distribution classes. Existing methods mainly follow two paradigms: filtering suspicious samples or incorporating unlabeled objectives with soft weighting. We argue that both face a common trade-off: aggressive filtering can discard informative but hard ID samples, whereas utilization can introduce auxiliary gradients that conflict with supervised learning when pseudo labels are wrong. We therefore shift the focus from sample selection to gradient-level control. We propose \textit{Geometric Gradient Rectification} (GGR), a plug-in framework that uses the supervised gradient as an anchor and projects conflicting auxiliary gradients onto an admissible region in gradient space. This makes the applied auxiliary update first-order non-opposing within the rectified coordinate block while preserving orthogonal components that may still carry useful representation signals. We further extend GGR with subspace-aware rectification to stabilize the anchor under noisy mini-batch gradients. Experiments on CIFAR and ImageNet benchmarks show that GGR improves representative OSSL baselines in most settings and yields gains in both closed-set generalization and open-set robustness. Code will be available at https://github.com/JiaheChen2002/GGR.
