Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the correlation between image thresholding objective functions (Otsu's and Kapur's) and evaluation metrics (SSIM and PSNR) to assess potential biases in segmentation quality evaluation. By exhaustively evaluating all possible thresholds on the BSDS500 dataset, the study reveals a strong correlation between Otsu's criterion and both SSIM and PSNR, while Kapur's entropy shows weaker and more variable correlation. These findings demonstrate an inherent bias in evaluation metrics towards specific objective functions used in image thresholding.
Image segmentation benchmarks may be inadvertently favoring methods that align with the biases of commonly used evaluation metrics like SSIM and PSNR.
Multilevel image thresholding is widely used for segmentation in applications ranging from medical imaging to remote sensing. Classical objective functions, such as Otsu's between-class variance and Kapur's entropy, are often optimized using metaheuristic algorithms, with performance evaluated via metrics like Structural Similarity Index (SSIM) and Peak Signal-to-Noise Ratio (PSNR). These evaluations implicitly assume that SSIM and PSNR provide unbiased measures of segmentation quality. In this study, we examine this assumption by analyzing the correlation between thresholding objective functions and quality metrics across all possible thresholds for images in the BSDS500 dataset. Results show that Otsu's criterion consistently exhibits high correlation with both SSIM and PSNR, while Kapur's entropy demonstrates weaker and more variable correlation. Otsu outperforms Kapur in correlation with PSNR for all images and with SSIM for over 91%. Our findings reveal an inherent metric-objective-function bias. This work highlights the need for more neutral evaluation frameworks and motivates extending the analysis to additional thresholding criteria and domains. Source code of this paper can be found at https://w3id.org/met-dp/icpr26-95