Search papers, labs, and topics across Lattice.
This paper introduces a unified framework for Khmer text recognition and word segmentation, addressing the challenges posed by the absence of visible word delimiters in the Khmer language. By employing a connectionist-temporal-classification (CTC) decoder, the model allows for efficient parallel decoding, enabling it to recognize text both with and without word segmentation. Experimental results across various document modalities demonstrate significant improvements in accuracy and processing speed, effectively eliminating the need for a separate segmentation model.
A unified model for Khmer text recognition eliminates the need for error-prone word segmentation, streamlining document processing.
Text recognition, or extracting electronic text from document images, has been indispensable for knowledge retrieval tasks, such as retrieval-augmented generation (RAG). For Khmer, extracted text is subject to an extra word segmentation step, as Khmer does not use any visible word delimiters to denote word boundaries. Thus, a recognition-then-segmentation pipeline for Khmer requires two separate sequential models; this is not only error-prone but also adds significant latency for large-scale document processing. This paper proposes a novel joint Khmer text recognition and word segmentation framework in a unified model. The proposed model, using a connectionist-temporal-classification (CTC) decoder for fast, parallel decoding, can be instructed to recognize Khmer text with ($b=1$) and without ($b=0$) word segmentation. Experimental results on different benchmark datasets of different document modalities (document, scene, and handwritten images) show that the proposed model can not only recognize characters in document images but also locate word boundaries, removing the need for an extra word segmentation step in a conventional sequential pipeline.