Search papers, labs, and topics across Lattice.
The authors address the severe seen-class misclassification bias in generalized zero-shot learning (GZSL) by reframing seen-versus-unseen class discrimination as a statistical out-of-distribution inference problem. Their model-agnostic framework wraps any existing GZSL feature extractor as a black box and deploys an ensemble of lightweight Monte Carlo bias-correctors to gate test samples before downstream classification. Tested on large-vocabulary zero-shot handwriting recognition, this debiasing strategy achieves over 20% relative accuracy gains on unseen words and demonstrates that large-scale vocabulary discrimination is viable in as few as ~15 dimensions.
Scaling generalized zero-shot recognition to massive vocabularies does not require re-architecting backbones: treating seen-versus-unseen gating as a downstream Monte Carlo calibration problem boosts unseen accuracy by over 20% in just 15 dimensions.
Generalized zero-shot learning (GZSL) has emerged as an important paradigm for visual recognition systems that must generalize to classes that were not observed during training. Traditional GZSL techniques are limited by their applicability to a relatively small number of such unseen classes, scalability beyond which is challenging due to its well-known misclassification bias towards classes observed during training. In this work, we investigate the GZSL paradigm through the lens of zero-shot handwritten word recognition over extremely large vocabularies. We propose a statistical approach to rectifying this bias, which views any classical GZSL feature learner as a black box mechanism whose intrinsic bias in identifying the training status (seen vs. unseen) of a typical data point we aim to correct, similar to an out of distribution inferential problem. Our method leverages a simple two-stage hierarchical architecture, combining a classical GZSL blackbox in the first stage and an ensemble of lightweight Monte Carlo bias-correctors in the second. Once debiased, the classification of test data is undertaken only restricted to its predicted training status via well-founded statistical methods (eg nearest neighbour, logistic regression and random forests). We achieve relative accuracy improvements of over 20% in the classification of unseen words compared to established techniques. A key outcome is that word recognition over large scale vocabularies is amenable to a much lower dimensional representation (~15 dimensions). Our approach is underpinned by mathematical analysis that captures the essence of the statistical approach to bias correction. Our approach to bias rectification can be combined in a turn-key fashion with any classical GZSL learner as a blackbox, thereby suggesting a wide scope of applicability of this method for a wide variety of GZSL implementations in different domains.
NUS