Zhixiong Zhao

TWLA achieves unprecedented 1.58-bit weight and 4-bit activation quantization while preserving accuracy, revolutionizing the deployment of large language models.

MoBiE slashes the cost of running Mixture-of-Experts models, achieving 2x speedups and massive accuracy gains by intelligently binarizing weights *without* adding storage overhead.