Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces TreeCCA, a novel method that applies gradient-boosted trees to canonical correlation analysis (CCA), traditionally reliant on linear or neural encoders. By leveraging the Eckart-Young loss, TreeCCA enables end-to-end training of tree ensembles, achieving superior performance on synthetic benchmarks and real-world datasets while maintaining interpretability through feature importance insights. The results indicate that TreeCCA not only matches but often exceeds the performance of existing CCA methods, offering a more efficient and interpretable alternative for multi-view data analysis.
TreeCCA achieves nonlinear correlation extraction with gradient-boosted trees, outperforming traditional methods while providing clear feature importance insights.
Gradient-boosted trees dominate tabular machine learning, yet canonical correlation analysis has always relied on linear or neural encoders. We propose \textbf{TreeCCA}, the first method to train gradient-boosted tree ensembles end-to-end as CCA encoders, inheriting their plug-and-play reliability: no architecture design, familiar hyperparameters, and strong performance with defaults. The technical enabler is the Eckart-Young (EY) loss, which supplies closed-form per-sample gradients that slot directly into any standard GBT library (XGBoost, LightGBM) as a custom objective. TreeCCA is the first CCA method to combine nonlinear accuracy with native interpretability: every tree split selects one feature, so gain importances reveal which inputs drive cross-view correlation at no extra cost. We demonstrate these properties on synthetic benchmarks, where TreeCCA matches or exceeds Deep CCA (2.61 vs.\ 2.43 on Signed Power; 2.93 vs.\ 2.89 on Hermite), and on a sparse benchmark with zero linear cross-view covariance, where TreeCCA recovers the true support with $\text{Precision@}S = 1.00$ at $p=50$ while PMD finds no signal. On the UCI HAR sensor-fusion benchmark, TreeCCA achieves comparable accuracy to Deep CCA at $5\times$ lower cost, while XGBoost gain importances directly validate a physics-motivated hypothesis about the data --- an interpretation not readily available with neural encoders. Across five popular tabular multi-view datasets, TreeMCCA consistently matches or exceeds linear CCA in both nonlinear correlation extraction and downstream classification accuracy.