Output Consultation Plans and Statistical Disclosure Control Strategy developments Angele Storey and Jane Longhurst ONS.

Slides:



Advertisements
Similar presentations
Quality Improvement in the ONS Cynthia Z F Clark Frank Nolan Office for National Statistics United Kingdom.
Advertisements

GEOSS Data Sharing Principles. GEOSS 10-Year Implementation Plan 5.4 Data Sharing The societal benefits of Earth observations cannot be achieved without.
Health and Safety Executive Health and Safety Executive Construction (Design and Management) Regulations 2007 Training Package Session 1- Overview Version:
Data security and controlling access Managing research data well workshop London, 30 June 2009 Manchester, 1 July 2009.
2011 Census Outputs Dissemination Plans Working in Partnership Chris Ashford – ONS Census Outputs.
Will 2011 be the last Census of its kind in England and Wales? Roma Chappell, Programme Director Beyond 2011 Office for National Statistics, July 2011.
The Impact of LFS & APS Reweighting Marilyn Thomas Labour Force Survey Output Manager, Office for National Statistics.
Statistical Disclosure Control (SDC) for 2011 Census Progress Update Keith Spicer – ONS SDC Methodology 23 April 2009.
Requirements for 2011 Cross-sectional Microdata SARs Support Team University of Manchester
Requirements for 2011 Cross-sectional Microdata Ed Fieldhouse SARs Support Team University of Manchester
Confidentiality and the SARs Update on SAR progress, and discussion of the disclosure work done for Scotland. Sam Smith
2011 Census Outputs Plans and Progress. CONTENTS Aims for 2011 Census Outputs Strategy Development User Consultation Next Steps.
THE BRITISH CRIME SURVEY: PRESENTATION TO THE BCS USER GROUP 11 December 2007 Progress with data archiving Last meeting we described our review of current.
Balancing Access and Confidentiality Jenny Telford Australian Bureau of Statistics September 2008.
The Statistics Act and Research Access to Data Paul J Jackson Legal Services ONS.
Conference Programme Introduction to the Samples of Anonymised Records - Keith Spicer, ONS CCSR's role in providing SAR's support - Jo Wathan,
The Samples of Anonymised Records: Understanding Individual differences Mark Brown.
MA Department of Education Calculating Graduation Rates Massachusetts Department of Education November 2006 Bob Bickerton, Senior Associate Commissioner:
Progress on the SDC Strategy for the 2011 Census 23 rd June 2008 Keith Spicer and Caroline Young.
1 Budgets and Budgetary Control Prepared and Presented By Gladstone K. Hlalakuhle.
Statistical Disclosure Control (SDC) at SURS Andreja Smukavec General Methodology and Standards Sector.
Data linking – Project update 15 th May 2012 – Homecare & SDS event Atlantic Quay Ellen Lynch & Euan Patterson.
SSRG Annual Workshop 2011: How can the Children in Need census help to improve children’s services and outcomes? Monday 7 th March Birmingham Isabella.
Census 2011 Output Content and User Consultation Joe Traynor.
Working together to implement SWTF recommendations on social work education and training.
Harmonising Standard Questions, Classifications and Concepts at the ONS Palvi Shah and Becki Aquilina 1.
Statistical Disclosure Control Philip Johnston, Information Services Division, NHSNSS ScotPHO training course, 1 April 2011.
Access routes to 2001 UK Census Microdata: Issues and Solutions Jo Wathan SARs support Unit, CCSR University of Manchester, UK
2001 Census Programme Delivering UK Census Data to Researchers: Progress and Challenges David Martin University of Southampton and ESRC/JISC Census Programme.
Financial Model ‘An integrated model for STFC’ Draft Blueprint Design v0.1 Project Manager: Mark Affonso Project Champion: Jane Tirard.
Preparing Scotland’s first Records Management Plan Ava Wieclawska Records Manager.
United Nations Economic Commission for Europe Statistical Division Applying the GSBPM to Business Register Management Steven Vale UNECE
GEOG3025 Census and administrative data sources 2: Outputs and access.
LOOKING TOWARDS 2011 Ian Cope Director 2011 Census.
Statistical Disclosure Control for the 2011 UK Census Jane Longhurst, Caroline Young and Caroline Miller (ONS)
WP. 46 Providing access to data and making microdata safe, experiences of the ONS Jane Longhurst Paul Jackson ONS.
1 Statistical Disclosure Control Methods for Census Outputs Natalie Shlomo SDC Centre, ONS January 11, 2005.
1 Statistical Disclosure Control for Communal Establishments in the UK 2011 Census Joe Frend Office for National Statistics.
Plans for Access to UK Microdata from 2011 Census Emma White Office for National Statistics 24 May 2012.
Accreditation practices at the Hungarian Central Statistical Office Zoltán Vereczkei Methodology Department Hungarian Central Statistical Office
Luisa Franconi Integration, Quality, Research and Production Networks Development Department Unit on microdata access ISTAT Essnet on Common Tools and.
User-focused Threat Identification For Anonymised Microdata Hans-Peter Hafner HTW Saar – Saarland University of Applied Sciences
Bowel Screening Project Overview Rhys Blake Head of Business and Service Development.
1 Assessing the Impact of SDC Methods on Census Frequency Tables Natalie Shlomo Southampton Statistical Sciences Research Institute University of Southampton.
2011 Census: Lessons learned from the Business Sector Dr Barry Leventhal MRS Census & Geodemographics Group CAG Meeting 8 th January 2015.
Developing Survey Handbooks as Educational Tools for Data Users Presented at the European Conference on Quality in Official Statistics May 2010 Deborah.
Access to sensitive data in the UK: a principles-based approach Felix Ritchie.
Looking forward Callum Foster, ONS. Quick summary/update on Beyond 2011/Census 2021  Beyond 2011 programme assessed a range of potential approaches 
WP 19 Assessment of Statistical Disclosure Control Methods for the 2001 UK Census Natalie Shlomo University of Southampton Office for National Statistics.
Statistical data confidentiality and micro data in Albania
JOINT UN-ECE/EUROSTAT MEETING ON POPULATION AND HOUSING CENSUSES GENEVA, MAY 2009 DETERMINING USER NEEDS FOR THE 2011 UK CENSUS IAN WHITE, Office.
Using Targeted Perturbation of Microdata to Protect Against Intelligent Linkage Mark Elliot, University of Manchester Cathie.
WYE CITY GROUP on Statistics on Rural Development and Agricultural Household Income Naman Keita FAO, Statistics Division Way forward for the Wye City Group:
Disclosure Control in the UK Census Keith Spicer 11 January 2005.
European Conference on Quality in Official Statistics, Rome, July 2008 Community Innovation Survey: a Flexible Approach to the Dissemination of Microdata.
Creating Open Data whilst maintaining confidentiality Philip Lowthian, Caroline Tudor Office for National Statistics 1.
Joint UNECE/Eurostat work session on statistical data confidentiality Manchester, December 2007 Dealing with Confidentiality in Dissemination: The.
Copyright 2010, The World Bank Group. All Rights Reserved. Managing processes Core business of the NSO Part 1 Strengthening Statistics Produced in Collaboration.
The Review of the Dissemination of Health Statistics Carole Abrahams Office for National Statistics.
The 2011 Census: Estimating the Population Alexa Courtney.
JOINT UN-ECE/EUROSTAT MEETING ON POPULATION AND HOUSING CENSUSES GENEVA, 7-9 JULY 2010 DISSEMINATING THE RESULTS OF THE 2011 CENSUS IN ENGLAND AND WALES.
Census 2011 – A Question of Confidentiality Statistical Disclosure control for the 2011 Census Carole Abrahams ONS Methodology BSPS – York, September 2011.
Hywel Dda Health Board Your Health Your Future Statutory Consultation on the Reconfiguration of Healthcare Services Carol Evans, Assistant.
11 Measuring Disclosure Risk and Data Utility for Flexible Table Generators Natalie Shlomo, Laszlo Antal, Mark Elliot University of Manchester
Progress towards a table builder with in-built disclosure control for 2021 Census Keith Spicer UNECE, 22 September 2017.
Confidentiality in Published Statistical Tables
Dissemination Workshop for African countries on the Implementation of International Recommendations for Distributive Trade Statistics May 2008,
Harmonisation process of anonymisation of microdata
Education and Training Statistics Working Group – June 2014
Albania 2021 Population and Housing Census - Plans
Presentation transcript:

Output Consultation Plans and Statistical Disclosure Control Strategy developments Angele Storey and Jane Longhurst ONS

Background Census users require a range of different outputs SARs are a key output Detailed information may raise confidentiality issues Requirements to protect data: –Public trust and cooperation –Legal rights and obligations –National and International standards for statistics To balance confidentiality requirements with maximising utility to meet user needs Need comprehensive understanding of user needs and then

Update on….. User consultation Progress on Microdata Statistical Development Control (SDC) developments

User consultation–tabular output Current activities are focussing on understanding users high level output requirements for tabular output and microdata samples 38 in-depth interviews conducted with users drawn from across census user communities On-line survey planned to test emerging themes with wider user base

User consultation–tabular output cont… Areas that are being explored with users in the interviews and on-line consultation include –Balance of additivity, consistency, accuracy in tables –Level and complexity of outputs used and required –Strength of user requirement for flexible output and level of flexibility required –Metadata use and requirements –Access, dissemination methods and media Census Personas as aid to output design

2011 Census output geography ONS consultation on small area geography for England and Wales: Nov 06 to Feb 07 _Geography_Policy.aspttp:// _Geography_Policy.asp Conclusions: –High degree of stability at both OA and SOA level –Minimal changes after Census 2011 limited to less than 5% of the OAs nationally –changes made by simple mergers and splits OA/SOA hierarchy will be primary output geography for 2011 Census output

Progress on microdata Census Microdata Strategy Working Group (CMSWG) set up May 2007 Includes representatives from CCSR, GROS and NISRA Responsible for determining strategy for specification and production of 2011 Census microdata samples First step – to explore high level user requirements for 2011 Census microdata samples CCSR : Presenting initial findings from survey this pm Survey findings will be considered at next meeting of CMSWG

Key future dates in microdata work programme April 08 – Feb 09 - CCSR consultation with users on content of microdata samples - CCSR work with ONS to develop draft of statistical specification Feb 09 – June 09 - CCSR consult formally on statistical specification of microdata samples Dec 10 - Final agreed specifications for microdata samples Jan11 onwards - Development, production, testing and delivery stages

Approach to developing SDC policy and methodology for 2011 Census output SDC for 2011 Census outputs is a major concern for users Different SDC methodologies were adopted for standard tabular 2001 Census outputs across the UK Late addition of small cell adjustment by ONS/NISRA resulted in high level of user confusion and dissatisfaction Publicised commitment to aim for a common UK SDC methodology for all 2011 Census outputs

Approach continued.. Phase 1 (March 06 – Jan 07) –UK agreement of key SDC policy issues Phase 2 (Jan 07 – Sept 08) –Evaluation of all methods complying with agreed SDC policy position in terms of risk/utility framework and feasibility of implementation Phase 3 (Sept 08 – April 09) –Recommendations and UK agreement of SDC methodologies for 2011 Census tabular outputs Phase 4 (Jan 09 onwards) –Evaluate and develop SDC methods for microdata, future work on output specification, system specification, development and testing

SDC progress RsG agreed high level SDC policy ? 2006 UK SDC working group established to take forward work UKCDMAC subgroup established to QA work Phase 2 (focus on tabular outputs): –Evaluation of 2001 –High level qualitative evaluation and short-listing of SDC methods for tabular output –Detailed quantitative evaluation of short-list

Qualitative criteria Primary criteria –Additivity and consistency –Over user acceptability –Protection against differencing –Feasibility of implementation Secondary criteria –Impact on microdata releases –Simple to understand –Easy to account for in analyses

SDC short-list Record swapping Over-imputation ABS Cell Perturbation method Small cell adjustment with record swapping (to provide comparison with 2001)

Quantitative evaluation Evaluate short-list Range of tables using 2001 Census data Balance between risk and utility Combine quantitative results with qualitative criteria Aligned with work on Outputs, Downstream Processing and Geography Continued communication and consultation with users

Timetable Phase 1 (March 06 – Jan 07) –UK agreement of key SDC policy issues Phase 2 (Jan 07 – Sept 08) –Evaluation of all methods complying with agreed SDC policy position in terms of risk/utility framework and feasibility of implementation Phase 3 (Sept 08 – Spring/Summer 09) –Recommendations and UK agreement of SDC methodologies for 2011 Census tabular outputs Phase 4 (Feb 09 onwards) –Evaluate and develop SDC methods for microdata, future work on output specification, system specification, development and testing

Risk Assessment for microdata Disclosure risk depends on records that are unique in the sample and in the population Evaluate risk using scenarios and quantitative risk measures

Risk assessment for microdata Disclosure risk scenarios –Assumptions concerning prior knowledge of intruder and information available to him, e.g. private database, journalist, nosy neighbour –Identify key variables - indirectly identifying variables –Use this process to decide what needs to be protected against –Need to update scenarios Quantitative risk measures –Percentage of population uniques that are in the file –Identify high risk records

SDC for Microdata Perturbative methods –PRAM (implemented for 2001 Census SAR) –Record swapping –Adding noise Non-perturbative methods –Recoding (implemented for 2001 Census SAR) –Suppression –Sub-sampling Mixed strategies Different methods will be evaluated Need to recognise interdependence with SDC method for tabular outputs

Access Options End user licence access to low (but not zero) risk data Special licence access to detailed but anonymised data On-site laboratory access - safe centre Remote access/execution

Impact of legislation Statistics and Registration Services Act – April 2008 Personal information held by the Board must not be disclosed unless an exemption holds –E.g. to an approved researcher ONS approved researcher working group ONS SDC microdata standards working group

Summary Ongoing progress made for 2011 Census Output consultation –Tables –Microdata –Geography Statistical disclosure control –Short-list of SDC methods for protecting tables –Quantitative evaluation of short-list –Future work on microdata