Search papers, labs, and topics across Lattice.
This paper introduces a two-stage abstraction and refinement (ABS-REF) view for modular feature extraction in point cloud processing, highlighting the importance of the refinement stage in recent models. They propose a High-dimensional Positional Encoding (HPE) module to explicitly utilize positional information and replace time-consuming local MLPs with non-local MLPs for efficient information updates. The resulting HPENets, a suite of MLP networks incorporating HPE, achieves state-of-the-art performance on multiple point cloud processing tasks with significantly reduced FLOPs compared to PointNeXt.
Achieve state-of-the-art point cloud processing accuracy with HPENets while slashing FLOPs by up to 79% compared to PointNeXt by using high-dimensional positional encoding and non-local MLPs.
Multi-Layer Perceptron (MLP) models are the foundation of contemporary point cloud processing. However, their complex network architectures obscure the source of their strength and limit the application of these models. In this article, we develop a two-stage abstraction and refinement (ABS-REF) view for modular feature extraction in point cloud processing. This view elucidates that whereas the early models focused on ABS stages, the more recent techniques devise sophisticated REF stages to attain performance advantages. Then, we propose a High-dimensional Positional Encoding (HPE) module to explicitly utilize intrinsic positional information, extending the ``positional encoding'' concept from Transformer literature. HPE can be readily deployed in MLP-based architectures and is compatible with transformer-based methods. Within our ABS-REF view, we rethink local aggregation in MLP-based methods and propose replacing time-consuming local MLP operations, which are used to capture local relationships among neighbors. Instead, we use non-local MLPs for efficient non-local information updates, combined with the proposed HPE for effective local information representation. We leverage our modules to develop HPENets, a suite of MLP networks that follow the ABS-REF paradigm, incorporating a scalable HPE-based REF stage. Extensive experiments on seven public datasets across four different tasks show that HPENets deliver a strong balance between efficiency and effectiveness. Notably, HPENet surpasses PointNeXt, a strong MLP-based counterpart, by 1.1% mAcc, 4.0% mIoU, 1.8% mIoU, and 0.2% Cls. mIoU, with only 50.0%, 21.5%, 23.1%, 44.4% of FLOPs on ScanObjectNN, S3DIS, ScanNet, and ShapeNetPart, respectively. Source code is available at https://github.com/zouyanmei/HPENet_v2.git.
