Ganqu Cui

Short-context models can achieve superior reasoning performance by leveraging long-context teacher models through innovative token alignment and training strategies.

Draft-OPD accelerates inference by over 5x while improving speculative decoding accuracy, transforming how draft models learn from target feedback.