Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors map prompt selection for Group Relative Policy Optimization (GRPO) onto the Bernoulli Fisher–Rao manifold using the arc-length coordinate $\psi = \arcsin\sqrt{p}$, revealing that expected updates, zero-variance boundary layers, and pass@$k$ gradients reduce to closed-form Gaussians. Building on this geometry, they introduce ARCUS, a drop-in sampler that tracks prompt difficulties via an arc-length Kalman filter and prioritizes high-yield, informative groups to avoid zero-gradient rollouts. Across six math reasoning benchmarks and three backbones, ARCUS boosts reasoning accuracy by up to 2.9 points over vanilla GRPO while cutting rollout generation by 48–57% compared to dynamic sampling.
GRPO wastes roughly half its rollouts on zero-variance batches, but reparameterizing pass rates onto the Bernoulli Fisher–Rao arc length turns prompt curriculum design into a closed-form Gaussian selection problem that cuts sampling compute in half.
Group relative policy optimization (GRPO) learns only from prompts whose sampled responses disagree: a group that is entirely correct or entirely incorrect has zero reward variance, contributes no gradient, and still consumes its rollouts. Prompt-selection methods reduce this waste by steering sampling toward intermediate pass rates, but they choose the target, its width, and the uncertainty model heuristically, in raw pass-rate or logit coordinates. We show that GRPO comes with a natural coordinate for pass rates: the arc length $ψ=\arcsin\sqrt{p}$ on the Bernoulli Fisher--Rao manifold. In arc length, the expected GRPO update is uniform up to two boundary ramps; the probability of a zero-variance group is bounded by two Gaussian boundary layers of width $1/\sqrt{2G}$; pass-rate evidence has constant noise; and the gradients of the pass@$k$ and pass$^k$ objectives are Gaussians whose center and width follow from $k$ in closed form. A prompt curriculum for GRPO is therefore a Gaussian in arc length, and choosing its center amounts to choosing the objective. We turn this observation into ARCUS, a drop-in sampler that tracks every prompt with a Kalman filter in arc length, scores prompts by an objective-matched Gaussian kernel times the predicted probability of an informative group, keeps only informative groups for the unchanged GRPO update, and paces the target toward the hardest objective whose predicted yield stays within a small slack of the best. Across six mathematical reasoning benchmarks and three backbones, ARCUS improves the average accuracy of GRPO by 2.8--2.9 points and that of dynamic sampling by 1.1--1.2 points, while generating 48--57\% fewer rollouts than dynamic sampling.