Search papers, labs, and topics across Lattice.
To resolve systematic representation bias and brittle optimization in continuous-embedding feature engineering, this work designs a tabular feature transformation framework combining a hierarchical representation learner with policy-guided reinforcement learning. Addressing the flaw that transformation sequences are inherently order-invariant yet typically encoded with order-sensitive bias, the architecture employs self-attention pooling to map equivalent structures to identical embeddings while modeling cross-level operational hierarchies. Across diverse tabular benchmarks, the resulting multi-objective RL search consistently beats strong generative and heuristic baselines by jointly optimizing predictive performance and transformation efficiency.
Treating automated feature transformations as permutation-invariant hierarchies rather than ordered sequences eliminates a fundamental representation bias, enabling policy-guided RL to efficiently navigate non-convex search spaces.
Feature transformation improves predictive performance on tabular data by constructing informative abstractions from raw features. Recent generative approaches encode transformation knowledge into continuous embedding spaces for efficient exploration of candidate strategies, but face three key limitations: (1) overlooking hierarchical relationships between low-level features, operations, and high-level abstractions; (2) enforcing order-sensitive embeddings on inherently permutation-invariant transformation sequences, thereby introducing systematic bias; and (3) relying on gradient-based search, which is ill-suited to non-convex transformation spaces. We propose a framework with two complementary components. First, a permutation-invariant hierarchical module captures interactions across features, operations, and abstraction levels, with a self-attention pooling mechanism that maps semantically equivalent structures to consistent embeddings aligned with downstream performance. Second, a policy-guided multi-objective reinforcement learning strategy initializes the search from empirically strong seeds and jointly optimizes predictive accuracy and transformation efficiency. Extensive experiments on diverse tabular benchmarks demonstrate the effectiveness and robustness of our framework against strong baselines. Our code and data are publicly available at: https://github.com/RayLiu1103/PHER.
