Search papers, labs, and topics across Lattice.
Affiliation:
1
0
3
12
An analytical framework for power-aware provisioning of PD-disaggregated AI inference is developed, derived from the joint distribution of input--output lengths and hardware compute and memory limits, which determines the serving capacity and average power consumption of a provisioned deployment.
