Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces an Instance Hardness-based relevance function (InHaR) designed to enhance the identification of rare instances in imbalanced regression problems, particularly in bimodal distributions. By incorporating the learning difficulty of instances alongside the target distribution, InHaR effectively distinguishes between truly rare and normal instances, addressing the limitations of traditional relevance functions. Experimental results show that InHaR significantly improves predictive performance when applied to resampling strategies like Random Oversampling and Gaussian Noise, outperforming conventional methods.
Rarity in regression isn't just about target values—learning difficulty plays a crucial role in accurately identifying rare instances.
Imbalanced regression problems arise when the target variable has an asymmetric distribution, resulting in underrepresented value ranges in the dataset. Traditional approaches for identifying rare instances rely on a relevance function that assigns higher importance to specific regions of the target distribution. However, the effectiveness of imbalance-aware learning methods depends strongly on how relevance is defined. In more complex scenarios, such as bimodal distributions, traditional relevance functions struggle to capture rarity, as they assign fixed relevance values based solely on target values, thereby compromising the distinction between truly rare and normal instances. To address these limitations, this study proposes an Instance Hardness-based relevance function (InHaR) for identifying rare instances in regression problems. Unlike traditional relevance functions, the proposed approach incorporates learning difficulty, allowing rarity to be inferred not only from the target distribution but also from the difficulty of instances for the learning algorithm. This property is particularly important in bimodal scenarios, where rarity cannot be accurately inferred from target values alone. Experimental results demonstrate that the InHaR correctly identifies rare regions under bimodal distributions and, when used to guide resampling strategies such as Random Oversampling (RO) and Gaussian Noise (GN), leads to significant improvements in predictive performance compared to traditional relevance-based approaches. The code, dataset, and further details about the proposed method are publicly available at https://github.com/VitorLeitao/instance-hardness-Imbalanced-regression.