Search papers, labs, and topics across Lattice.
To resolve rank selection and redundancy in latent factor models without heuristic truncation, this work develops a Bayesian nonparametric factor analysis framework that marginalizes a Dirichlet process prior over loading matrix columns using a spike-and-slab base measure. This formulation uniquely unites exact dictionary element merging, column exchangeability, and exact zeros, establishing minimax optimal posterior contraction at rate $\sqrt{s_0 \log n / n}$ for covariance estimation in the fixed-dictionary setting. In empirical evaluations, it proves to be the only fully adaptive method capable of exact rank recovery, outperforming even oracle baselines in covariance estimation and signal reconstruction.
Exact latent rank discovery in sparse factor analysis is achievable without stick-breaking approximations or truncation, matching minimax optimal covariance contraction while outperforming oracle baselines.
We propose a Bayesian nonparametric factor model that infers the number of factors, induces row-wise sparsity, and merges redundant dictionary elements via exact clustering. A Dirichlet process prior is placed on the columns of an overcomplete loading matrix and fully marginalized to an exact Pólya urn, avoiding stick-breaking and auxiliary variables. A spike-and-slab base measure allows entire factors to be exactly zero. The model uniquely combines exact zeros, exchangeability over columns, and exact merging within a single marginalized Dirichlet process, unlike CUSP, MGP, or the beta process. An exact Gibbs sampler with canonical relabeling and parallel C/MPI implementation is developed. We prove posterior contraction at rate $\sqrt{M s_0 \log n / n}$ for the covariance matrix, and in the fixed-dictionary setting obtain the minimax optimal rate $\sqrt{s_0 \log n / n}$ plus underfitting consistency; the overfitting direction is an open conjecture. The spike-and-slab is essential: without it the effective dimension scales as $pM$, yielding a slower rate. Simulations show the method is the only fully adaptive approach to recover the true rank, achieving the smallest covariance, loading, and signal-reconstruction errors, beating an oracle baseline. On van 't Veer breast cancer data ($n=97$, $p=1213$), the posterior concentrates on eight interpretable programmes; seven pass coherence and two pass Bonferroni-corrected Hallmark enrichment.