Search papers, labs, and topics across Lattice.
The paper introduces TFM-S3, a hybrid local-global policy optimization method for robotics that leverages tabular foundation models (TFMs) to guide exploration in a low-dimensional policy subspace. TFM-S3 interleaves high-frequency local policy updates with intermittent global search rounds, where a TFM predicts candidate returns within a dynamically updated policy subspace constructed via SVD. Experiments on continuous control benchmarks demonstrate that TFM-S3 accelerates early-stage convergence and improves final performance compared to TD3 and population-based methods under a fixed rollout budget.
Tabular foundation models can dramatically accelerate robot policy learning by enabling efficient global exploration within dynamically constructed policy subspaces.
Policy optimization in high-dimensional continuous control for robotics remains a challenging problem. Predominant methods are inherently local and often require extensive tuning and carefully chosen initial guesses for good performance, whereas more global and less initialization-sensitive search methods typically incur high rollout costs. We propose TFM-S3, a tabular hybrid local-global method for improving global exploration in robot policy learning with limited rollout cost. We interleave high-frequency local updates with intermittent rounds of global search. In each search round, we construct a dynamically updated low-dimensional policy subspace via SVD and perform iterative surrogate-guided refinement within this space. A pretrained tabular foundation model predicts candidate returns from a small context set, enabling large-scale screening with limited rollout cost. Experiments on continuous control benchmarks show that TFM-S3 consistently accelerates early-stage convergence and improves final performance compared to TD3 and population-based baselines under an identical rollout budget. These results demonstrate that foundation models are a powerful new tool for creating sample-efficient policy learning methods for continuous control in robotics.
