Haodi Lei

Short-context models can achieve superior reasoning performance by leveraging long-context teacher models through innovative token alignment and training strategies.

Even the best LLMs struggle with Olympiad-level combinatorics, achieving only 65.4% on a benchmark designed to expose their reasoning limitations.

Draft-OPD accelerates inference by over 5x while improving speculative decoding accuracy, transforming how draft models learn from target feedback.