Search papers, labs, and topics across Lattice.
This paper addresses the critical issue of decision alignment in synthetic data used for decision support systems (DSS) by introducing the PolicySynth framework, which ensures that synthetic populations yield the same campaign decisions as real data. The authors propose a new metric, strategy simulation fidelity (SSF), to measure this alignment, achieving high SSF scores of 0.923 and 0.960 on telecommunications and banking datasets, respectively. Notably, PolicySynth demonstrates significantly tighter variance in decision recommendations compared to existing methods, enhancing the reliability of synthetic data in marketing strategies.
Achieving over 92% fidelity in decision-making with synthetic data could revolutionize how businesses leverage privacy-preserving analytics for campaign strategies.
Decision support systems (DSS) increasingly run retention what-if analysis on synthetic customer populations, because privacy constraints preclude unrestricted use of real data. Such a system is trustworthy only if the synthetic data lead managers to the same decisions as the real data would; yet prevailing criteria certify distributional similarity, not decision alignment, so a synthetic population can match every marginal distribution while still steering a marketing team toward the wrong campaigns. We close this decision-alignment gap with three contributions: strategy simulation fidelity (SSF), a criterion measuring how often the synthetic population yields the same go/no-go campaign decision as the real population; PolicySynth, a DSS framework whose generator is conditioned on the production churn scorer to align decision-relevant structure; and a three-axis reporting standard of decision alignment, membership-inference resistance, and novel-record rate as the minimum deployment quality gate. On a telecommunications churn corpus and a banking acquisition corpus, PolicySynth attains a mean SSF of 0.923 and 0.960, with seed-to-seed variance roughly ten times tighter than CTGAN on telecommunications and 2.5 times on banking. This stability is the deployable property: go/no-go recommendations shift by at most 1.2 percentage points between monthly retraining cycles, against 11.5 for CTGAN, a reversed recommendation on one campaign in nine. A bootstrap baseline matches PolicySynth on SSF yet copies real records verbatim and fails membership inference, evidence that no single axis suffices. PolicySynth reliably supports directional go/no-go screening; its ROI estimates diverge from real outcomes by 70 to 78% and require the volume correction we document.