Search papers, labs, and topics across Lattice.
This paper introduces a benchmarking framework specifically designed for evaluating the performance of various implementations of the density matrix renormalization group (DMRG) algorithm, which is crucial for studying quantum systems. By systematically comparing eight different DMRG implementations, the authors reveal performance discrepancies of up to two orders of magnitude, influenced by parameter settings and optimization strategies. The findings underscore the importance of rigorous performance evaluations to guide users and developers in making informed decisions and improving software efficiency.
Performance differences among DMRG implementations can reach up to 100x, revealing critical insights for researchers in quantum computing.
The performance of scientific software often determines the scale of problems that can be solved in practice. As multiple implementations of the same algorithm emerge, systematic evaluation is needed to compare their strengths and limitations. The density matrix renormalization group (DMRG) algorithm, widely used to study quantum systems, has over 50 software implementations. These implementations vary in multiple aspects that can strongly affect performance. However, despite the need, performance evaluations of these implementations are scarce and lack a consistent standard; many existing evaluations are either too incomplete to enable meaningful comparisons or focus on objectives other than direct performance comparisons, thereby limiting understanding of how the implementations compare. Here, we present a performance-oriented benchmarking framework to facilitate meaningful comparisons of DMRG implementations, and we apply it to quantify the performance of eight implementations, highlighting similarities and differences among them. Furthermore, we examine multiple parameter settings, optimization strategies, and implementation-specific features to demonstrate how parameter configuration can affect performance and how systematic evaluation can reveal non-obvious trade-offs. The results show significant performance differences, up to two orders of magnitude in some cases, not only between different implementations when aligning parameters, but also within the same implementation when comparing different parameter configurations. Hence, our results demonstrate the significant value and insight that can be gained from conducting rigorous performance evaluations. Using our results and framework as a starting point, more rigorous benchmarking will ultimately help users and developers make informed decisions and support future development efforts to build better, more efficient software.
