Dataset Quality Assurance Checklist & Statistical Disclosure Control
HDX – Humanitarian Data Exchange
Dataset Quality Assurance Checklist
HDX quality assurance(QA) officers should check each new or updated dataset against this checklist to ensure datasets shared on HDX meet the minimum HDX quality standards for datasets.
The checklist is in three parts:
- A checklist for dataset resources,
- A data responsibility checklist
- A metadata quality checklist.
Microdata – Statistical Disclosure Control on HDX
handling microdata
To handle the microdata shared on HDX, we use an open-source software package for Statistical Disclosure Control (SDC) called sdcMicro. The tool was developed by Statistics Austria, the Vienna University of Technology, the International Household Survey Network (IHSN), PARIS21 (OECD), and the World Bank.
The SDC process in the sdcMicro is divided into three steps:
- Perform a disclosure risk assessment by identifying the key variables.
- Apply SDC methods to reduce the risk of disclosing information on individuals.
- Re-measure the risk and quantify the information loss.
Workflow
- New Microdata is Added to the Platform
- Perform Quality Assurance Checks
- Assess Disclosure Risk
- Inform Contributor
- Applying SDC
- Re-Assessing Risk and Quantifying Information Loss
- Sharing Data Via HDX Connect
Details:
https://humanitarian.atlassian.net/wiki/spaces/HDXKB/pages/1381498881/Statistical+Disclosure+Control+on+HDX
– – – – – – – – – – – – – – – – – – – – – – –
The HDX proposals for Dataset Quality Assurance and for Statistical Disclosure Control formal models are important steps and show the large potential for application of such methodology and techniques to be extended into many other domains of RISK Information Management.
Horst Kremers