Search papers, labs, and topics across Lattice.
This paper introduces a benchmarking framework for optimizing AI models on ARM Cortex-M series processors (M0+, M4, M7) by evaluating energy efficiency, accuracy, and resource utilization. The framework automates the evaluation process across key performance indicators and employs Pareto analysis to identify optimal processor/model combinations balancing energy consumption and accuracy. Results show that the M7 processor is best for short inference cycles, the M4 for longer, energy-efficient tasks, and the M0+ for simpler tasks.
Forget brute-force – Pareto analysis reveals the sweet spot between energy consumption and model accuracy for AI on ARM Cortex processors, guiding developers to sustainable embedded AI.
This work presents a practical benchmarking framework for optimizing artificial intelligence (AI) models on ARM Cortex processors (M0+, M4, M7), focusing on energy efficiency, accuracy, and resource utilization in embedded systems. Through the design of an automated test bench, we provide a systematic approach to evaluate across key performance indicators (KPIs) and identify optimal combinations of processor and AI model. The research highlights a nearlinear correlation between floating-point operations (FLOPs) and inference time, offering a reliable metric for estimating computational demands. Using Pareto analysis, we demonstrate how to balance trade-offs between energy consumption and model accuracy, ensuring that AI applications meet performance requirements without compromising sustainability. Key findings indicate that the M7 processor is ideal for short inference cycles, while the M4 processor offers better energy efficiency for longer inference tasks. The M0+ processor, while less efficient for complex AI models, remains suitable for simpler tasks. This work provides insights for developers, guiding them to design energy-efficient AI systems that deliver high performance in realworld applications.
