Statistics Canada’s Real Time Remote Access Solution 2011 MSIS Meeting – Karen Doherty May 2011.

Slides:



Advertisements
Similar presentations
DLI Orientation: Concepts A Framework for Thinking about Statistical Information Train the Trainers Montreal, March 9, 2004 Chuck Humphrey Data Library.
Advertisements

Balancing Access and Confidentiality Jenny Telford Australian Bureau of Statistics September 2008.
Eurostat T HE E UROPEAN PROCESS OF ENHANCING ACCESS TO E UROSTAT DATA A LEKSANDRA B UJNOWSKA E UROSTAT.
The Microdata Analysis System (MAS): A Tool for Data Dissemination Disclaimer: The views expressed are those of the authors and not necessarily those of.
Inter-Agency Child Protection
State of Indiana Business One Stop (BOS) Program Roadmap Updated June 6, 2013 RFI ATTACHMENT D.
Input Data Warehousing Canada’s Experience with Establishment Level Information Presentation to the Third International Conference on Establishment Statistics.
Update on the Impact of Corporate Business Architecture on IT at StatCan 2011 MSIS Meeting Karen Doherty May 2011.
Data Access and Data Use: the Missing Link? Elizabeth Hamilton University of New Brunswick Chuck Humphrey University of Alberta Data and Knowledge Transfer.
Farm Business and Farm Household Survey Data Customized Data Summaries from ARMS for Statistical Analysis Philip Friend USDA ‘s Economic Research Service.
INDEPTH Network INDEPTH Data Systems Kobus Herbst.
United Nations Expert Group Meeting on Revising the Principles and Recommendations for Population and Housing Censuses New York, 29 October – 1 November.
MSF Testing Introduction Functional Testing Performance Testing.
Chapter 7 Database Auditing Models
Country Paper on: Census Data Accessibility, Confidentiality and Copyright Policy: Ethiopia’s Experience Seminar United Nations Regional Seminar on Census.
The Canadian Census of Population: a Review in Preparation for 2016 UNECE Group of Experts on Population and Housing Censuses May 23, 2012.
United Nations Economic Commission for Europe Statistical Division Applying the GSBPM to Business Register Management Steven Vale UNECE
Internal Auditing and Outsourcing
Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September 2011 Overview of Archiving of Microdata Session 4 United Nations.
TESTING STRATEGY Requires a focus because there are many possible test areas and different types of testing available for each one of those areas. Because.
Integration of Service Channels Strategies for Success Iain McKellar, Director, Advisory Services Division.
Case Studies: Statistics Canada (WP 11) Alice Born Statistics UNECE Workshop on Statistical Metadata.
Data Warehousing at STC MSIS 2007 Geneva, May 8-10, 2007 Karen Doherty Director General Informatics Branch Statistics Canada.
Internal Communications: Introducing and Managing Change France Mondoloni Communications and Information Services Branch June 2011.
M ETADATA OF NATIONAL STATISTICAL OFFICES B ELARUS, R USSIA AND K AZAKHSTAN Miroslava Brchanova, Moscow, October, 2014.
Confidentiality and Security Issues in ART & MTCT Clinical Monitoring Systems Meade Morgan and Xen Santas Informatics Team Surveillance and Infrastructure.
Dissemination to support Research & Analysis John Cornish.
Population census micro data for research: the case of Slovenia Danilo Dolenc Statistical Office of the Republic of Slovenia Ljubljana, First Regional.
Dr. David Mowat June 22, 2005 Federal, Provincial & Local Roles Surveillance of Risk Factors and Determinants of Chronic Diseases.
Database Security and Auditing: Protecting Data Integrity and Accessibility Chapter 7 Database Auditing Models.
Current and Future Applications of the Generic Statistical Business Process Model at Statistics Canada Laurie Reedman and Claude Julien May 5, 2010.
Framework of Statistical Information. This is a typology of the categories or classes of statistical information. Remember the relationship between statistics.
Innovations in Data Dissemination Thomas L. Mesenbourg, Jr. Acting Director U.S. Census Bureau United Nations Seminar on Innovations in Official Statistics.
Copyright 2010, The World Bank Group. All Rights Reserved. ICT - a core management issue Part 1 Managing ICT resources Produced in Collaboration between.
Developing Survey Handbooks as Educational Tools for Data Users Presented at the European Conference on Quality in Official Statistics May 2010 Deborah.
Collection Architecture 2009 MSIS Meeting – Oslo, Norway Karen Doherty May 18, 2009.
1 Census Data Dissemination and Utilization A Case of China 2010 Census.
Population Census Data Dissemination through Internet H. Furuta Lecturer/Statistician SIAP 1 Training Course on Analysis and Dissemination of Population.
Michelle Simard Statistics Canada UNECE Worksessions on Statistical Disclosure Control Methods Helsinki, October 2015 Development of rules from administrative.
Disclosure Avoidance at Statistics Canada INFO747 Session on Confidentiality Protection April 19, 2007 Jean-Louis Tambay, Statistics Canada
26 August 2011 Future of access to EU confidential data for scientific purposes Jean-Marc Museux Eurostat – 58th ISI conference,
Statistical data confidentiality and micro data in Albania
© Federal Statistical Office, Research Data Centre, Maurice Brandt Folie 1 ESSnet Projects “Decentralised Access to EU microdata” Maurice Brandt Research.
Slide 1 Eurostat Unit B3 – Statistical Information Technologies CoRD Meeting – 4 June 2007 Agenda Item 8 Preliminary ideas for a 2011 census hub Giuseppe.
Lyne Guertin Census Data Processing and Estimation Section Social Survey Methods Division Methodology Branch, Statistics Canada UNECE April 28-30, 2014.
PwC New Technologies New Risks. PricewaterhouseCoopers Technology and Security Evolution Mainframe Technology –Single host –Limited Trusted users Security.
Regional Seminar on Promotion and Utilization of Census Results and on the Revision on the United Nations Principles and Recommendations for Population.
Michelle Simard, Thérèse Lalor Statistics Canada CSPA Project Manager UNECE Work Session on Statistical Data Confidentiality Helsinki, October 2015 Confidentialized.
Development of UK Virtual Microdata Laboratory Felix Ritchie Shanghai, March 2010.
Management Information System
David Price October 2011 Real Time Remote Access (RTRA) #10.
Chapter © 2012 Pearson Education, Inc. Publishing as Prentice Hall.
Michelle Simard Joint UNECE/Eurostat Work Session on Statistical Data Confidentiality Tarragona, Spain, November 23 rd, 2011 Progress on Real Time Remote.
19-20 October 2010IT Directors’ Group Meeting 1 Item 3.3.g of the agenda Vision Infrastructure Project on Secure Infrastructure for CONfidential data access.
Wesley Yung and Claude Poirier 2015 World Statistics Congress CSPA from a Methodologist’s Point of View.
Opportunities: Administrative Data, Data Linkage, New Initiatives, Expanding access Health, Justice, Special Surveys Branch October 2015.
2011 Canadian Census – Field Management System 2010 MSIS Meeting – Daejeon, Korea Karen Doherty April 26, Statistics Canada Statistique.
Development of UK Virtual Microdata Laboratory
Data Confidentiality and the Common Good.
Secure Data Laboratories: The U.S. Census Bureau Model
SISAI STATISTICAL INFORMATION SYSTEMS ARCHITECTURE AND INTEGRATION
Presentation 2b 2018 Census Products & Services Engagement.
ESS Security Survey ESTAT LISO – B0.
Tomaž Špeh, Rudi Seljak Statistical Office of the Republic of Slovenia
DAT381 Team Development with SQL Server 2005
Albania 2021 Population and Housing Census - Plans
Item 2.2 of the Agenda Remote access to confidential data for researchers: possible actions under the 7th Framework Programme Pascal JACQUES Unit B 5 15.
Changes in the Canadian Census of Population Program
DLI Annual Report Spring 2019
Presentation transcript:

Statistics Canada’s Real Time Remote Access Solution 2011 MSIS Meeting – Karen Doherty May 2011

Statistics Canada Statistique Canada 2 Background  Access to, and analysis of, StatCan data is fundamental to the fulfilment of our mandate.  Traditionally provided access through: Aggregate data posted on the Agency’s website; Public use microdata files (PUMFs); and Special and customizations of aggregate data.  Currently 20 Research Data Centres (located in universities) provide access to confidential microdata files to researchers across the country

Statistics Canada Statistique Canada 3 Background  StatCan is facing increasing demands for greater access to detailed microdata  Advances in IT offer opportunities for producing, disseminating, mining analysing data  Researchers are frustrated with the impediments to data access imposed by StatCan

Statistics Canada Statistique Canada 4 RTRA – The Business Solution  An on-line remote access facility that allows researchers to run data analyses on microdata sets  Data sets are stored in a central and secure location under the control and care of StatCan

Statistics Canada Statistique Canada 5 Data Access Strategy

Statistics Canada Statistique Canada 6 Development of a Working System  Phase 1 – completed 2009 Identification of business requirements focusing on components such as security, legal, and functionality  Phase 2 – completed 2010 Pilot version – limited number of researchers and restrictions on types of requests allowed and level of details provided  Phase 3 – first production version – 2011 Functionality will be expanded incrementally in order to evaluate security measures and mitigate risks

Statistics Canada Statistique Canada 7 Solution Approach  Examined lessons learned from other NSIs  Determined key requirements of the model  Adopted a model similar to the ABS model  Built on existing e-File Transfer (e-FT) facility to securely transfer files across the “air gap”  Security issues addressed via 4 four control points: Secure dataset housing Secure transit of datasets Registered Users validation Confidentiality rules for output  Right balance of risk versus security

Statistics Canada Statistique Canada 8 How RTRA Works Researcher submits SAS program Request passes through firewalls to secure server Upon vetting, tables are returned to researcher in specified format If request does not comply submission will not be run and the log will be returned for adjustment All submissions are monitored and logged and logs are kept for auditing purposes

Statistics Canada Statistique Canada 9 How RTRA Works  Pre-Scan of requests: Limits access to data files Ensures that the programming guidelines have been followed Uses automated SAS process to control output  Post-Scan of outputs: Applies a controlled rounding algorithm to output tables Limits each submission to 10 tables Limits each researcher to 10 successful program submission per day Supports two formats for output (.sas7dbat and HTML)

Statistics Canada Statistique Canada 10 Methodological Challenge  No absolute criterion for defining confidential data, however in terms of disclosure control, StatCan applies risk management practises to safeguard the confidentiality of microdata  Developed specific rules: Slightly masked microdata files Automatic disclosure rules for tabular outputs Pre-scan for inputs Post-scan for the outputs  Strategy involves trade-offs of the four potential methodologies, any decision involves managing risk and consideration of levels of security

Architecture of RTRA – Design Statistics Canada Statistique Canada 11 Technologies File Transfer – e-FT Services (COTS) Workflow Components - SAS User Authentication – SAS and StatCan Customer Relations Management System (CRMS) Archive – Folder Data Views – SAS Automated Workflow – SAS Sniffer Post-Scan – StatCan rounding tool RNDII.exe

User Interface Statistics Canada Statistique Canada 12 User creates a request

User Interface Statistics Canada Statistique Canada 13 User logs onto RTRA from StatCan website

User Interface Statistics Canada Statistique Canada 14 User submits the request Resulting data to be delivered to an external FTP server via StatCan e-FT system

Future Direction  Adjust service based on client feedback for requirements and to tap into wider audience of academics and the private sector  Bring the solution in-sync with new WAN infrastructure used by Research Data Centres  Increase availability of additional cross-sectional surveys to researchers  Develop vetting procedures for longitudinal surveys and administrative data Statistics Canada Statistique Canada 15

2011 Work Plan  Quality indicators for frequency indicators – June 2011  Means, medians, percentiles, ratios and proportions – August 2011  Investigate support for other programming languages such as SPSS – on-going  Add Census information – November 2011  Work with Generalized Tabulation System (G-Tab) development team to see if G-Tab can automated confidentiality by types of output – beginning in Statistics Canada Statistique Canada 16

Statistics Canada Statistique Canada 17 Conclusion  Starting to gain traction among Government of Canada researchers.  As the system evolves Statistics Canada believes this tool will become a key component of the toolset available to researchers such as: policy researchers in government departments and agencies (federal, provincial, or municipal) academic researchers in Canadian universities any other researcher who agrees to the RTRA terms and conditions of use