Wencong Zhang

Softmax doesn't require explicit exponentials: directly mapping shifted scores to block-scaled E2M1 codes slashes vector-stage latency by 40% while exceeding standard MXFP4 accuracy on frontier LLMs and VLMs.

Transforming feature relationships through geometric guidance leads to consistent performance gains in both image classification and reasoning tasks across multiple architectures.