Search papers, labs, and topics across Lattice.
This paper analyzes the time complexity of data movement in memory hierarchies, revealing that the cost of data access scales with the fourth root of data size, \(N^{1/4}\), rather than the traditionally assumed constant cost. This finding is significant for understanding scalability in a common class of applications, as it highlights how access costs increase with larger datasets. The analysis also distinguishes between scenarios where the miss ratio follows a power law versus an exponential decay, providing insights into performance implications.
Accessing larger datasets could cost significantly more than previously assumed, scaling with the fourth root of size rather than remaining constant.
Time complexity typically assumes $O(1)$ cost per data access. This paper presents an analysis based on an abstract memory hierarchy. For a common class of applications, it shows that the data-access cost scales with the fourth root of data size, that is, as data size $N$ increases, the cost of each access increases at the rate of $N^\frac{1}{4}$. While the analysis does not predict performance, it predicts scalability. Specifically, the paper provides a precise analysis that shows the constant-factor difference between cases where the miss ratio follows a power law versus an exponential decay.
