Search papers, labs, and topics across Lattice.
This paper introduces TransAnyText, a structured visual code framework designed to enhance cross-border e-commerce image translation by generating renderable HTML patches from source images and target languages. By decoupling semantic generation from pixel rendering, the framework employs a vision-language model for visual understanding and translation, complemented by a diffusion model for pixel-level refinement. Extensive experiments reveal that TransAnyText outperforms existing methods in accuracy, visual identity preservation, and editability, establishing a new benchmark in e-commerce image translation.
TransAnyText achieves superior e-commerce image translation by transforming image text into editable HTML patches, setting a new standard for accuracy and visual fidelity.
Cross-border e-commerce image translation is essential for global retail, where product images, banners, and detail pages need to be produced in different languages. Existing methods struggle to achieve accurate translation, faithful visual identity preservation, and easy-to-edit outputs, simultaneously. To address these challenges, we introduce TransAnyText, a structured visual code framework that reformulates image text translation as generating renderable HTML patches from source images and target languages. Our framework decouples semantic generation from pixel rendering: a vision-language model (VLM) handles visual understanding, cross-lingual translation, and structured visual generation, while a diffusion model performs background inpainting and pixel-level refinement, followed by deterministic rendering to synthesize the final image. Based on this formulation, we develop a three-stage post-training framework, where supervised fine-tuning (SFT) establishes the image-to-code mapping, privilege-gap weighted self-distillation (PWSD) improves the learning of style and layout tokens, and reinforcement learning with verifiable rewards (RLVR) further optimizes task-level performance. We further introduce TransAnyDataset and TransAnyBench, a multilingual dataset and benchmark for e-commerce image translation. Extensive experiments demonstrate competitive performance against cascaded pipelines, open-source end-to-end models, and closed-source image editing systems, providing an effective, controllable, and editable solution for cross-border e-commerce image translation.
