Search papers, labs, and topics across Lattice.
This study investigates the reuse of pre-deployment evaluation rollouts to enhance policy selection in robot teams using vision-language-action (VLA) policies. By employing outcome-disjoint cross-fitting, the authors demonstrate that a transparent probe-success rule significantly improves held-out success rates from 46.86% to 61.49% across a substantial dataset of 34,752 LIBERO-Plus rollout records. The findings indicate that while learned scorers can match the performance of the probe-success rule, the true value lies in the commissioning process, which effectively enhances routing without necessitating increased model complexity.
A transparent probe-success rule boosts robot policy selection success rates by over 14 percentage points, revealing the hidden power of pre-deployment evaluations.
We study whether pre-deployment evaluation rollouts can be reused to supervise policy selection. Robot teams routinely smoke test candidate vision-language-action (VLA) policies, then compress those trials into a global winner. RouterVLA evaluates this idea with outcome-disjoint cross-fitting: recorded probes build a profile for each frozen expert, and a separate trial scores the selected expert without entering its profile. Across 34,752 LIBERO-Plus rollout records, a transparent probe-success rule raises held-out success from 0.4686 to 0.6149, a +14.64pp gain. Under the scalar-only profiles studied here, learned scorers are statistically indistinguishable from this rule, showing that commissioning carries the routing value while extra scalar scorer capacity does not create it. Reusing the scored trial inflates the measured gain by $1.87\times$, so credible ledger routing needs outcome separation; model scaling improves individual policies, while commissioning-aware routing improves the system built from them.
Tsinghua AI