Search papers, labs, and topics across Lattice.
The paper introduces PCT-Prompt, a novel framework that enhances standard Transformers for dense prediction tasks in point clouds by incorporating a prompt-guided feature branch. This framework addresses the limitations of standard Transformers in complex scenes by leveraging a fine-grained feature extraction block and a prompt-refined feature learning block, which together improve the model's ability to capture both local and global features. Experimental results on multiple datasets, including ShapeNetPart and S3DIS, show that PCT-Prompt significantly outperforms traditional methods, demonstrating its effectiveness in real-world applications.
PCT-Prompt transforms dense prediction in point clouds by integrating prompt-guided features, leading to substantial performance gains over standard Transformers.
Standard Transformers have proven effective in point cloud object classification, but their performance in dense prediction tasks within complex scenes is often hindered by weak prior assumptions. To address this challenge, we propose PCT-Prompt, a novel framework that enhances standard Transformers by introducing a prompt-guided feature branch to improve performance in dense prediction tasks. The standard Transformer branch leverages pre-trained models for global feature extraction from point cloud data, serving as the backbone for processing high-level features. Meanwhile, the prompt-guided feature branch consists of two key components: a fine-grained feature extraction block that captures multi-scale geometric features using geometry-sensitive abstraction layer, along with the PnP-3D layer to integrate local context with global regularization. The second component, the prompt-refined feature learning block generates prompt tokens, which are subsequently refined through cross-attention mechanisms. Additionally, we introduce a prompt drop mechanism that progressively removes prompt information across Transformer layers, balancing local details and global consistency. Experimental results on the ShapeNetPart, S3DIS, and DALES datasets demonstrate that PCT-Prompt significantly improves the adaptability of standard Transformers to dense prediction tasks, achieving strong performance in real-world scenarios.
