Search papers, labs, and topics across Lattice.
The paper introduces GT-PCQA, a novel MLLM-based no-reference Point Cloud Quality Assessment framework designed to overcome limitations in existing PCQA datasets and the texture-dominant bias of MLLMs. GT-PCQA employs a 2D-3D joint training strategy to leverage large-scale IQA datasets for instruction tuning via LoRA, and a geometry-texture decoupling strategy using a dual-prompt mechanism with alternating optimization. Experiments demonstrate GT-PCQA's competitive performance and generalization capabilities in assessing point cloud quality.
By decoupling geometry and texture cues, GT-PCQA overcomes the texture bias of MLLMs to achieve state-of-the-art point cloud quality assessment, even with limited PCQA data.
With the rapid advancement of Multi-modal Large Language Models (MLLMs), MLLM-based Image Quality Assessment (IQA) methods have shown promising generalization. However, directly extending these MLLM-based IQA methods to PCQA remains challenging. On the one hand, existing PCQA datasets are limited in scale, which hinders stable and effective instruction tuning of MLLMs. On the other hand, due to large-scale image-text pretraining, MLLMs tend to rely on texture-dominant reasoning and are insufficiently sensitive to geometric structural degradations that are critical for PCQA. To address these gaps, we propose a novel MLLM-based no-reference PCQA framework, termed GT-PCQA, which is built upon two key strategies. First, to enable stable and effective instruction tuning under scarce PCQA supervision, a 2D-3D joint training strategy is proposed. This strategy formulates PCQA as a relative quality comparison problem to unify large-scale IQA datasets with limited PCQA datasets. It incorporates a parameter-efficient Low-Rank Adaptation (LoRA) scheme to support instruction tuning. Second, a geometry-texture decoupling strategy is presented, which integrates a dual-prompt mechanism with an alternating optimization scheme to mitigate the inherent texture-dominant bias of pre-trained MLLMs, while enhancing sensitivity to geometric structural degradations. Extensive experiments demonstrate that GT-PCQA achieves competitive performance and exhibits strong generalization.
