Search papers, labs, and topics across Lattice.
1
0
2
0
This work predicts single-sequence model throughput from GGUF metadata using roofline-shaped predictors with quantization-specific scale factors fitted on reference models with fitted efficiencies not universal.