Search papers, labs, and topics across Lattice.
This paper introduces a novel three-stage pipeline for hardware-aware Neural Architecture Search (NAS) that integrates Post-Training Quantization (PTQ) effects on the Pareto space of neural architectures. By empirically analyzing how INT4 PTQ impacts the NAS-Bench-201 architecture set, the authors reveal that a zero-shot FP32 surrogate significantly outperforms an INT4-trained surrogate in terms of Pareto space coverage. This work not only clarifies the relationship between quantization and architecture design but also provides a framework for optimizing hardware mapping on reconfigurable accelerators.
INT4 quantization can distort the architecture landscape, but a zero-shot FP32 surrogate offers a surprising advantage in maintaining Pareto optimality.
Edge AI deployment demands neural architectures that are simultaneously accurate, computationally efficient, and hardware-deployable - a challenge addressed by hardware-aware Neural Architecture Search (NAS). While recent works incorporate quantization directly into the NAS loop, these approaches expand search complexity and tightly couple architecture and quantization design. The simpler post-search quantization strategy has received little analytical attention: the effects of Post-Training Quantization (PTQ) on the NAS-discovered Pareto structure remain uncharacterised, and no framework combines quantized architecture mapping onto reconfigurable accelerators with automated hardware exploration. This paper addresses both gaps. First, a three-stage pipeline is proposed: a hardware-agnostic Pareto rank surrogate frontend on NAS-Bench-201, a quantization bridge with Pareto-aware filtering and feedback control, and an evolutionary Domain Space Exploration (DSE) backend on CGRA4ML for optimal hardware mapping. Second, an empirical study characterises how INT4 PTQ perturbs the NAS-Bench-201 Pareto space through formal stability metrics on ground-truth data for all 15,625 architectures, and demonstrates that an FP32 zero-shot surrogate outperforms a dedicated INT4-trained surrogate in Pareto space coverage across two standard search strategies.
