Search papers, labs, and topics across Lattice.
This paper introduces HiFi-LLP, a high-fidelity latency predictor leveraging graph attention networks to enhance hardware-aware neural architecture search (HW-NAS) by providing accurate latency estimates with a confidence metric. By addressing the limitations of existing platform-specific predictors, which require extensive sampling and can mislead the NAS process, HiFi-LLP demonstrates a significant improvement in prediction accuracy, achieving up to 9 percentage points better performance within a 10% accuracy margin and a Spearman鈥檚 rank correlation of 0.996 across six devices. Additionally, the proposed hybrid NAS framework effectively routes low-confidence predictions to hardware-in-the-loop (HIL) testing, resulting in an impressive 8.6脳 speedup in the optimization process while preserving a competitive Pareto front.
Achieving up to 9 percentage points improvement in latency prediction accuracy, HiFi-LLP revolutionizes hardware-aware neural architecture search efficiency.
With deep neural networks (DNNs) increasingly deployed on edge devices, hardware (HW)-aware optimization techniques鈥攕uch as HW-aware compression and HW-aware neural architecture search (HW-NAS)鈥攈ave become essential. These methods rely on real feedback from the target hardware to tailor DNN architectures for efficient deployment. While the search can be parallelized, latency measurements via hardware-in-the-loop (HIL) remain a bottleneck due to their sequential nature. Recent approaches use latency predictors to replace costly HIL feedback, but challenges persist: (1) platform-specific predictors often require tens of thousands of samples, and (2) inaccurate predictions can mislead the NAS process. To address this, we introduce HiFi-LLP, a high-fidelity, low-cost latency predictor based on graph attention networks, augmented with a confidence metric. HiFi-LLP outperforms prior platform-specific predictors by up to 9 percentage points (p.p.) in the 10% accuracy bound and achieves a Spearman鈥檚 rank correlation of up to 0.996 across six devices in the LatBench dataset. We further propose a hybrid NAS framework that routes low-confidence predictions to HIL, achieving up to 8.6脳 speedup compared to typical NAS while maintaining a competitive Pareto front. Code is available at https://github.com/shamvbs/HiFi-LLP. 1
