Search papers, labs, and topics across Lattice.
This paper introduces PeTeR, a post-training framework that enhances the robustness of pre-trained probabilistic circuits (PCs) against distribution shifts without the need for retraining from scratch. By employing distributionally-robust optimization within a Wasserstein ball of the empirical distribution, PeTeR addresses the fragility of standard likelihood-based learning methods, which often overfit and struggle with noisy or limited data. Empirical results show that PeTeR significantly improves the performance of baseline models against both random and adversarial perturbations, outperforming traditional data-dependent robust learning approaches.
PeTeR can transform pre-trained probabilistic circuits into robust models without retraining, outperforming conventional methods in challenging scenarios.
Probabilistic circuits (PCs) can model complex joint distributions while supporting exact and efficient computation of many inference queries. However, standard likelihood-based PC learning is vulnerable to overfitting and fragile generalization when confronted with data noise, small sample sizes, or distribution shifts. This can be mitigated using distributionally-robust optimization which consider worst-case distributions within a Wasserstein ball of the empirical distribution, but current methods are limited to training a model from scratch in this framework. Instead, we propose PeTeR: a novel, data-free post-training framework designed to robustify pre-trained PCs against distribution shifts without retraining from scratch. Empirical evaluations across multiple density estimation benchmarks demonstrate that PeTeR effectively robustifies baseline models against both random and adversarial perturbations, achieving competitive or superior performance to data-dependent robust learning baselines.
