Qingyang Zhang

Exposing the critic to both successful and failed same-prompt rollouts as contrastive foils resolves PPO's notoriously brittle credit assignment in multi-step reasoning—retaining its efficacy even when paired with a downscaled critic.

AI agents can only correctly synthesize implementations and proofs for less than two-thirds of tested multi-module software repositories, revealing significant gaps in current capabilities.