Search papers, labs, and topics across Lattice.
The paper introduces CAFE, a novel automated feature engineering (AFE) framework that integrates causal discovery with multi-agent reinforcement learning to construct robust feature representations. CAFE first learns a causal graph to guide feature selection and transformation, then employs a cascading multi-agent deep Q-learning architecture with hierarchical reward shaping to optimize feature construction. Experiments on 15 benchmarks demonstrate that CAFE achieves up to 7% performance improvement over existing AFE methods, exhibits improved convergence, and shows significantly enhanced robustness under covariate shift.
Causal priors dramatically improve the robustness of automated feature engineering, reducing performance drops by 4x under distribution shift compared to non-causal methods.
Automated feature engineering (AFE) enables AI systems to autonomously construct high-utility representations from raw tabular data. However, existing AFE methods rely on statistical heuristics, yielding brittle features that fail under distribution shift. We introduce CAFE, a framework that reformulates AFE as a causally-guided sequential decision process, bridging causal discovery with reinforcement learning-driven feature construction. Phase I learns a sparse directed acyclic graph over features and the target to obtain soft causal priors, grouping features as direct, indirect, or other based on their causal influence with respect to the target. Phase II uses a cascading multi-agent deep Q-learning architecture to select causal groups and transformation operators, with hierarchical reward shaping and causal group-level exploration strategies that favor causally plausible transformations while controlling feature complexity. Across 15 public benchmarks (classification with macro-F1; regression with inverse relative absolute error), CAFE achieves up to 7% improvement over strong AFE baselines, reduces episodes-to-convergence, and delivers competitive time-to-target. Under controlled covariate shifts, CAFE reduces performance drop by ~4x relative to a non-causal multi-agent baseline, and produces more compact feature sets with more stable post-hoc attributions. These findings underscore that causal structure, used as a soft inductive prior rather than a rigid constraint, can substantially improve the robustness and efficiency of automated feature engineering.
