Search papers, labs, and topics across Lattice.
This paper introduces TMP, a Tree-structured Mixed-policy Pruning framework designed to significantly reduce the parameter count of large-scale image generation models while maintaining acceptable quality. By applying TMP, the authors successfully compressed the HunyuanImage 3.0 model from 80 billion to 20 billion parameters, achieving a 75% reduction with minimal impact on generation quality, and optimized it for inference on a single 24GB GPU. Additionally, TMP was validated on the Z-Image turbo model, demonstrating a 33% parameter reduction with negligible degradation in performance.
Compressing state-of-the-art image generation models by up to 75% without sacrificing quality could revolutionize resource efficiency in AI image synthesis.
Modern image generation model rapidly grows their sizes to meet high-fidelity image synthesis. However, they gradually become unaffordable for their enormous parameter consumption and computation budget that lead to massive resources requirement and gpu memory footprint. In this paper, we propose TMP, the first Tree-structured Mixed-policy Pruning framework that generalizes prevalent image tasks (T2I and TI2I) and architectures (Mixture-of-Experts (MoE) and Diffusion transformer (DiT)). It could be applied to the step-distilled models and contribute as the last stage. We perform experiments upon current open-sourced SOTA HunyuanImage-3.0 instruct and a popular efficient model Z-Image turbo. The proposed pruning framework manages to compress HunyuanImage 3.0 from 80B to 20B parameters at 75% reduction ratio, sacrificing limited generation quality. We also optimize to enable the inference of the pruned 20B version of HunyuanImage 3.0 on a single 24GB 4090 GPU by engineering skills. The inference script and model weight have been integrated into the existing HunyuanImage3.0 open-source github and huggingface repository. Besides, we prove the efficacy of TMP by compressing Z-Image turbo from 6B to 4B (33% reduction) with negligible degradation.
