Search papers, labs, and topics across Lattice.
TextBoost addresses the challenge of preserving scene text fidelity in ultra-low bitrate image compression by incorporating auxiliary textual information extracted via OCR. The method adaptively filters OCR outputs to create a guidance map, fuses this guidance with decoder features using an attention mechanism, and enforces guidance-consistent reconstruction via a regularizing loss. Experiments on TextOCR and ICDAR 2015 show TextBoost achieves up to 60.6% higher text-recognition F1 score at comparable PSNR and bits per pixel, demonstrating improved small-font text sharpness and global image quality.
Achieve 60% higher text recognition in ultra-low bitrate images by injecting OCR-derived semantic guidance into the decoding process, sidestepping the usual ROI coding trade-offs.
Ultra-low bitrate image compression faces a critical challenge: preserving small-font scene text while maintaining overall visual quality. Region-of-interest (ROI) bit allocation can prioritize text but often degrades global fidelity, leading to a trade-off between local accuracy and overall image quality. Instead of relying on ROI coding, we incorporate auxiliary textual information extracted by OCR and transmitted with negligible overhead, enabling the decoder to leverage this semantic guidance. Our method, TextBoost, operationalizes this idea through three strategic designs: (i) adaptively filtering OCR outputs and rendering them into a guidance map; (ii) integrating this guidance with decoder features in a calibrated manner via an attention-guided fusion block; and (iii) enforcing guidance-consistent reconstruction in text regions with a regularizing loss that promotes natural blending with the scene. Extensive experiments on TextOCR and ICDAR 2015 demonstrate that TextBoost yields up to 60.6% higher text-recognition F1 at comparable Peak Signal-to-Noise Ratio (PSNR) and bits per pixel (bpp), producing sharper small-font text while preserving global image quality and effectively decoupling text enhancement from global rate-distortion optimization.
