Search papers, labs, and topics across Lattice.
This paper introduces GoodQ, a novel pipeline for Zero-Shot Quantization in Object Detection (ZSQ-OD) that leverages off-the-shelf generative models to synthesize training data without access to original datasets. By addressing key challenges such as dense information in images, class distribution imbalance, and noise from pseudo-labels, GoodQ employs strategies like Information-Dense Prompting and Teacher-guided Adaptive Noise Reduction. The framework achieves state-of-the-art performance in low-bit quantization (W4A4) and extends capabilities to extreme bit-widths (W3A3), significantly enhancing the deployment of object detectors on edge devices.
Generative models can transform the landscape of object detection quantization, achieving state-of-the-art performance even in extreme low-bit scenarios.
With an increasing number of Object Detection (OD) models being deployed on edge devices, Zero-Shot Quantization for OD (ZSQ-OD) aims to quantize these models when access to the original training data is prohibited. Existing research on Zero-Shot Quantization-Aware Training (QAT) for OD synthesizes training sets through noise optimization. However, this approach struggles to maintain performance in low-bit regions. In this paper, we introduce GoodQ (Generative off-the-shelf models for object detector Quantization), a QAT pipeline that utilizes off-the-shelf generative models to construct a training set. We first identify three challenges that arise when introducing a generative model to the ZSQ-OD task: 1) each image contains dense information with multiple instances, 2) the class-wise distribution in the original dataset is imbalanced, and 3) the pseudo-labels assigned to the generated images can potentially act as noisy signals during QAT. GoodQ addresses these challenges by 1) introducing an Information-Dense Prompting strategy to generate multi-instance images, 2) applying Intrinsic Distribution-Aware Selection to match the pretrained class distribution, and 3) employing Teacher-guided Adaptive Noise Reduction to mitigate noise arising from the QAT process. Our framework achieves state-of-the-art performance in low-bit ZSQ (W4A4) and extends quantization to extreme bit-widths (W3A3). Furthermore, we conduct an extensive analysis to uncover the underlying factors contributing to the efficacy of GoodQ.
