Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to generating synthetic data (SD) that ensures transparency and minimizes disclosure risk by maintaining specific relationships between variables. By calculating and coarsening margins where these relationships are preserved, the method guarantees that the synthetic data adheres to statistical disclosure control standards set by data custodians. The application of the Iterative Proportional Fitting (IPF) algorithm on historical data demonstrates the practicality and effectiveness of this approach in creating safe synthetic datasets.
Synthetic data can now be generated with guaranteed transparency and minimal disclosure risk, transforming how sensitive data can be shared and analyzed.
This paper proposes a method of creating synthetic data (SD) that will have two important advantages for the user compared to other methods currently available. The first is transparency; unlike other methods, the person in receipt of the SD will know which of the relationships between variables in the original data will be approximately maintained in the SD. The second is a guarantee that the SD is derived from information that has already been judged to be free of disclosure risk. This is achieved by first defining and calculating the margins where relationships between variables will be maintained in the SD. Each margin will then be subject to statistical disclosure control (SDC) to the standards defined by the data custodian, e.g. top-coding and bottom-coding, combination of small categories and/or modifying small counts. Further adjustment of the curated margins is advised by coarsening all counts in the table to multiples of the disclosure limit. These adjusted margins are used to create SD by the Iterative Proportional Fitting (IPF) algorithm. The practical steps involved in creating such SD are illustrated using data from the 1901 Census of Scotland.