Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors develop the Functional Spectral-Newton Method (FSNM) to learn the leading singular components of conditional expectation operators without relying on fixed bases or reproducing kernel Hilbert spaces. By casting the objective as low-rank density ratio estimation, the approach alternates functional Newton steps where each subproblem is solved via stagewise boosting with vector-valued regression trees. At the population level, the method achieves an $O(1/T)$ stationarity rate under weak-learner conditions and guarantees that every nondegenerate local minimum in centered $L^2$ is globally rank-$d$ optimal, allowing a single trained model to resolve multiple conditional queries without refitting.
Learning conditional expectation operators nonparametrically no longer requires pre-selected kernel bases or risking bad local optima—every nondegenerate local minimum over centered $L^2$ spaces is provably globally optimal.
We introduce the Functional Spectral-Newton Method (FSNM) for learning the leading singular structure of a conditional expectation operator without fixing a basis or reproducing kernel Hilbert space. FSNM fits a low-rank representation of the centered joint-to-product density ratio kernel by alternating functional Newton updates. Each update reduces to a preconditioned regression, which we approximate with vector-valued regression trees in a stagewise boosting procedure. At the population level, we establish descent and an $O(1/T)$ best-iterate block-stationarity rate under a relative weak-learner accuracy condition, and show that every nondegenerate local minimum over the full centered $L^2$ spaces is a globally optimal rank-$d$ approximation. Synthetic experiments show that FSNM recovers a low-rank density ratio and its leading spectral structure, and that the same learned kernel can answer multiple conditional queries without refitting.