Junmei Yang

A single-rollout RLVR method achieves faster training and more stable gradients by using a trajectory's own future as a hindsight context, eliminating the need for group sampling and reference solutions.

Preference optimization objectives, despite their diversity, can be steered towards disentangled dynamics that avoid suppressing the chosen response alongside the rejected one, simply by satisfying a "disentanglement band" condition.