Search papers, labs, and topics across Lattice.
This paper introduces Goal-Set Hindsight Relabeling (GS-HER), a novel approach that generalizes traditional hindsight relabeling by allowing achieved states to certify query-defined goal sets instead of fixed goal states. This method addresses the limitations of offline robot learning when task success is contingent on only a subset of state variables, thereby enhancing flexibility in goal specification. Experimental results across various OGBench tasks demonstrate that GS-HER significantly improves performance in scenarios where full-state goals are hindered by irrelevant dimensions, enabling a single model checkpoint to adapt to multiple goal predicates without retraining.
Query-defined goal sets can unlock greater flexibility in offline robot learning, allowing a single model to adapt to multiple tasks without retraining.
Hindsight relabeling usually turns achieved future states into exact goals, which can overconstrain offline robot learning when task success depends only on a subset of the state. We propose Goal-Set Hindsight Relabeling (GS-HER), a predicate-level generalization of HER in which achieved states certify query-defined goal sets rather than singleton goal states. A binary query specifies which variables define success, making the goal predicate an inference-time input while leaving the underlying offline GCRL algorithm unchanged. Across OGBench tasks and five offline goal-conditioned learners, GS-HER improves performance when full-state goals are bottlenecked by nuisance dimensions and turns hindsight relabeling into a reusable goal interface: one checkpoint can answer multiple robot goal predicates without retraining.