Search papers, labs, and topics across Lattice.
This paper introduces ATLAS, a novel framework for disentangling invariant and heterogeneous latent factors from high-dimensional covariates across diverse environments, leveraging auxiliary labels in a subset of these environments. By applying the invariance principle, ATLAS successfully separates aligned invariant factors from unaligned heterogeneous factors, enhancing the robustness and transferability of predictions in new environments. The method achieves near-oracle performance in latent factor regression while providing sharp non-asymptotic error bounds for factor recovery and signal estimation.
ATLAS achieves near-oracle performance in latent factor regression by effectively disentangling invariant and heterogeneous factors, even in the presence of diverse environments.
This paper considers a multi-environment factor model in which high-dimensional covariates are collected from heterogeneous environments, with auxiliary labels available in a subset of these environments. The joint distribution of the covariates may vary across environments, whereas the latent structure is decomposed into invariant factors with shared loadings and heterogeneous factors with environment-specific loadings. Such a model is motivated by transfer learning and latent factor regression, where one seeks stable low-dimensional representations for both interpretation and robust out-of-sample prediction of the response $Y$. Leveraging the invariance principle, we show that the invariant and heterogeneous factors are disentangled under a minimal structural condition. Based on this, we propose ATLAS, an Auxiliary-label and invariance-guided Transfer via Latent Alignment across heterogeneous environmentS. ATLAS is a unified procedure that leverages the invariance principle to separate aligned invariant and unaligned heterogeneous factors, and further exploits supervision from auxiliary labels to extract prediction-invariant and transferable factors from those unaligned heterogeneous factors. ATLAS yields near-oracle performance for downstream latent factor regression, enables transferable prediction in new environments through the full latent signal when auxiliary labels are available, and reduces to robust invariant-factor-only prediction otherwise. We establish sharp non-asymptotic error bounds for recovering invariant and heterogeneous factors, identifying all the response-invariant factors, and estimating the invariant signal in $Y$.
