Search papers, labs, and topics across Lattice.
Yifei Shi and Xin Xu are with the College of Intelligence Science and Technology, National University of Defense Technology, China. Boyan Wan and Kai Xu are with the College of Computer Science, National University of Defense Technology, China. Yifei Shi and Boyan Wan are joint first authors. Corresponding author: Kai Xu (kevin.kai.xu@gmail.com)
2
0
6
1
Achieve stable and competitive quantization for multimodal LLMs by explicitly accounting for modality-specific characteristics and cross-modal computational differences.
By strategically warming up residual connections layer-by-layer, ProRes unlocks faster and more stable pretraining for language models.
