Researchers’ Usage of Microdata The example of Statistics Finland Advanced presentation – Some additional details Consultation Mission on Promoting the.

Slides:



Advertisements
Similar presentations
Access to enterprise data at Statistics Finland: introducing the practices of the Research Laboratory Satu Nurmi OECD Conference: Assessing the feasibility.
Advertisements

OECD Conference Recent Developments in the Danish System for Access to Micro data Lars Borchsenius Head of Division Statistics Denmark.
Eurostat T HE E UROPEAN PROCESS OF ENHANCING ACCESS TO E UROSTAT DATA A LEKSANDRA B UJNOWSKA E UROSTAT.
Statistical Disclosure Control (SDC) at SURS Andreja Smukavec General Methodology and Standards Sector.
Implementation of the CoP in SLOVENIA Cooperation with data users Genovefa RUŽIĆ Deputy Director-General.
Workshop DwB, Lausanne, March 2014 Leo Engberts, accountmanager International Affairs Accreditation Data Service Statistics Netherlands.
Farm Business and Farm Household Survey Data Customized Data Summaries from ARMS for Statistical Analysis Philip Friend USDA ‘s Economic Research Service.
Business Archives in Finland EBNA, Brussels 18th November 2010 Jussi Nuorteva Director General.
P O L I C E D E P A R T M E N T  Biometric passport – Passport Act – Issuing a biometric passport – Development project  Biometric Passport To Biometric.
Development of Remote Access Systems Tanvi Desai LSE Research Laboratory Data Manager Research Laboratory IASSIST 2008: Stanford.
Luxembourg Income Study (LIS) asbl 17, rue des Pommiers L-2343 Luxembourg –City Tél : +(352) Fax: +(352)
Proposing the Model for Croatian Remote Access (RA) Safe Centre for Statistical Microdata Martina Poljičak Central Bureau of Statistics
Dissemination and statistical use of Business Register data Conference of European statisticians Group of experts of Business Registers Luxembourg, 6-7.
Introducing the data and practices of the Research Laboratory in Finland Satu Nurmi Entrepreneurship Indicators Steering Group Meeting Rome 5-6 December.
Session 4. Panel session: How useful is the notion of “circle of trust” concept ? A vision for the future. Maurice Brandt Destatis Germany 2ND EUROPEAN.
The Importance of User Relations for a Modern National Statistical Agency Presentation given by Petteri Baer at the Seminar on Dissemination NBS Moldova,
World Bank, Africa Region, Africa Household Survey Databank - The World Bank - Africa.
Documenting Register Data for Research Purposes Finnish Information Centre for Register Research Marianne Johnson Irma-Leena Notkola
Statistics Canada’s Real Time Remote Access Solution 2011 MSIS Meeting – Karen Doherty May 2011.
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
Access to microdata in Europe P resented by Michel Isnard – Insee DwB Training Course, Barcelona, Jan
Mara Cammarrota Italian National Institute of Statistics Development of Information System and Corporate Products, Information Management and Quality Assessment.
Population census micro data for research: the case of Slovenia Danilo Dolenc Statistical Office of the Republic of Slovenia Ljubljana, First Regional.
Lisbone, March ALBANIAN METADATA AlbMeta Prepared by INSTAT Working Group.
Innovations in Data Dissemination Thomas L. Mesenbourg, Jr. Acting Director U.S. Census Bureau United Nations Seminar on Innovations in Official Statistics.
Access to official statistical micro data at the Statistical Office of the Republic of Slovenia and cooperation with the Slovenian Social Science Data.
Electronic data collection system eSTAT in Statistics Estonia: functionality, authentication and further developments issues 4th June 2007 Maia Ennok,
Frameworks for the Access and Use of Administrative Data, With the Example of Current Practice in the UK Steven Vale Office for National Statistics UK.
RESEARCH DATA ACCESS IN A COMPLEX STATISTICAL SYSTEM, ITALY ATHENS OCTOBER, 2014 Ugo Trivellato Università di Padova and FBK-IRVAPP Second Regional.
United Nations Economic Commission for Europe Statistical Division Objects to be assessed in relation to USER RELATIONS in a Global Assessment EFTA-Eurostat-UNECE.
Administrative procedures for microdata access at SURS October 2013.
About the Secure Data Access For the academic research community in the UK Delivered by the UK Data Service/Archive Funded by the Economic and Social Research.
Electronic data collection System in CSB of Latvia By Karlis Zeila, Vice President, CSB of Latvia IT DG meeting, October , Eurostat.
26 August 2011 Future of access to EU confidential data for scientific purposes Jean-Marc Museux Eurostat – 58th ISI conference,
The experience of a National Statistical Institute after a law change: Estonia First Regional Workshop Microdata Access in European Countries ― Cooperation.
Access to microdata in Statistics Estonia First DwB European Data Access Forum Luxembourg, 28th March 2012 Tuulikki Sillajõe.
Implementation of the European Statistics Code of Practice Yalta September 2009 Pieter Everaers, Eurostat.
Creating a National Remote Access System for Register-based Research Marianne Johnson, Statistics Finland Statistical Data Confidentiality Work Session.
MetaPlus Klas Blomqvist Statistics Sweden Research and Development – Central Methods
Generic Statistical Information Model (GSIM) Jenny Linnerud
Nordic Marketing Conference of Statistical Products and Services Helsinki, Finland, June 13-15th Workshop 8: Product Development and Access to Individual.
DLI and EQUINOX Question 1 How do I find out what survey datasets are available from Statistics Canada ?
Overview and challenges in the use of administrative data in official statistics IAOS Conference Shanghai, October 2008 Heli Jeskanen-Sundström Statistics.
Licensing in a European Perspective - case Finnish National Consortium ELAG 2001, Prague Kristiina Hormia-Poutanen.
19-20 October 2010IT Directors’ Group Meeting 1 Item 3.3.g of the agenda Vision Infrastructure Project on Secure Infrastructure for CONfidential data access.
HETUS Pilot Group 8 Privacy procedures and ethical issues Kimberly Fisher, Centre for Time Use Research – co-ordinator External consultant Kai Ludwigs.
Joint UNECE/Eurostat work session on statistical data confidentiality October 2015 Helsinki, Finland Circle of trust Maurice Brandt DESTATIS.
Presented By Margaret Hellen Atiro Uganda Bureau of Statistics at the United Nations Regional Seminar on Census Data Archiving 20 – 23 Sep 2011, Addis.
Protecting Confidentiality in an NSI A broad field of activities Consultation Mission on Promoting the activity and Creating a positive image of the Ukrainian.
Researchers’ Usage of Microdata The example of Statistics Finland Advanced presentation Consultation Mission on Promoting the activity and Creating a positive.
How official statistics is produced Alan Vask
Improving Statistical Literacy by Statistics Finland Consultation Mission on Promoting the activity and Creating a positive image of the Ukrainian State.
Official Statistical Information - A key source for monitoring development and allocation of resources Consultation Mission on Promoting the activity and.
Researchers’ Usage of Microdata The example of Statistics Finland Basic presentation Consultation Mission on Promoting the activity and Creating a positive.
Building Relationships with Users Systematically A big Strategic Challenge for Statistical Agencies Consultation Mission on Promoting the activity and.
Effective Communication of Statistical Information Consultation Mission on Promoting the activity and Creating a positive image of the Ukrainian State.
Building Relationships with Users in a Systematic Way Background material for the development of a Dissemination and Marketing Strategy Consultation Mission.
The Luxembourg Income Study at Age 25
New challenges for archives in Iceland
Petteri Baer, Marketing Manager, Statistics Finland
Legal, political and methodological issues in confidentiality in the ESS Maria João Santos, Jean-Marc Museux Eurostat.
Marianne Johnson, Researcher. Services
Torben Søborg Theme 4.2 Remote access to Microdata Files from Researchers IT Directors Group 24 and 25 October 2005 Torben Søborg
YTY − an integrated production system for business statistics
Nicolás J. I. Rodríguez & Arild Mellesdal
Protecting Confidential Data
Estonia Martti Mandel Senior Expert
High-level Working Group on Statistical Confidentiality
Item 2.2 of the Agenda Remote access to confidential data for researchers: possible actions under the 7th Framework Programme Pascal JACQUES Unit B 5 15.
OVERVIEW ON STATISTICAL DATA CONFIDENTIALITY AND ACCES TO MICRODATA
Presentation transcript:

Researchers’ Usage of Microdata The example of Statistics Finland Advanced presentation – Some additional details Consultation Mission on Promoting the activity and Creating a positive image of the Ukrainian State Statistical bodies Kiev, Ukraine 9 – 12 December 2014 Petteri Baer, Marketing Manager, Statistics Finland Courtesy to Ms Marianne Johnson, Statistics Finland

Creation of an online access system to microdata The development roject started and ended Operation started in 2010 with 5 organizations, now 19 organizations and 100 users Mainly researchers using enterprise-level data as a starting point Increasing use needs (and possibilities!) by researchers using data on individuals The aim was to create a remote access system to microdata in order to increase Regional equality Data protection Efficient use of microdata Marianne Johnson/Research Services

The access structures to microdata in the way before the online system was created are still in use on a small scale (1) The microdata services started in 2001, around 10 projects/year Offered academic researchers the possibility to use enterprise-level data in their research projects Data sets that are released on a CD, DVD etc have to be anonymized, that is: Only samples of target groups are released Top coding Coarser classifications Marianne Johnson/Research Services

The access structures to microdata in the way before the online system was created are still in use on a small scale (2) Up until the renewal of the Statistics Act (1. Sept 2013) this was the most common way for researchers to access microdata on individuals The previous law stated that microdata can only be released in unidentifiable form, with few exceptions (i.e. some variables of business register data, as well as data on occupation, education and cause of death) SAS, Stata, SPSS and R are the main statistical tools used Customers today are mainly foreign researchers or researchers from Finnish universities and research institutes that do not have remote access agreement Marianne Johnson/Research Services

The new Statistics Act – Background factors for the renewal of the Act Goal to harmonize the national legislation on statistics with the new Regulation of the European Parliament and of the Council on European statistics Increased demand for comprehensive micro-level databases for research purposes during the last years A lot of feedback about high prices and the long time of delivery from and to the researchers using the earlier service structures Also much feedback about too small samples and too rough data protection A Working group to renew the Law was appointed by the Ministry of Finance in 2010 The purpose of the renewal of the Act was also to extend the use of the data collected for statistical purposes in scientific studies and statistical surveys on social conditions (section 3) Marianne Johnson/Research Services

The new Statistics Act – The main changes related to confidentiality issues Researchers can obtain data even though individuals can be identified indirectly (section 13) In cases referred to in Subsection 2, Paragraph 1, statistical authorities may not release such data from which the statistical unit could be directly identified. However, statistical authorities may give permission in cases referred to above to such confidential data from which the statistical unit could be indirectly identified. Data files where individuals or enterprises can be indirectly identified can only be accessed through remote access or on-site. Section 19 Statistics Finland may release, for use in scientific research or statistical surveys on social conditions, data with identification data on a person’s age, gender, education, occupation and socio-economic group provided that the recipient of the data is authorized to process such data under the Personal Data Act Marianne Johnson/Research Services

Rules related to the access to microdata Application and research plan => decision for usage => License to use micro data Pledge of secrecy Agreement with the research project A Committee for Statistical Ethics handles the most complicated micro-data access questions and provides guidance to the directors, who issue the permits Data limitations in enterprise data: Encryption of unit identifiers Removal of sensitive information Can only be used online or on-site For data on individuals Encryption of direct identifiers if used online or on-site Anonymization if released to researchers Petteri BaerKiev 9-12 December

The Remote access system The aim has been to create a remote access system to microdata in order to increase: + Regional equality + User-friendliness + Data protection + Efficient use of microdata Main practices are from Sweden, Denmark and the Netherlands Safe environment for authorized users only All microdata remains at Statistics Finland, the results of the data analyses are always checked Individual and enterprise level data protected by data disclosure rules Petteri BaerKiev 9-12 December

The Remote access system – Short description Researchers use data on Statistics Finland’s server at their own workplace via a secured Internet connection Research organisations are responsible for their users On the server researchers can use a Windows desktop, where they have access to the data permitted and metadata Statistical programs used: STATA, SPSS, R, SAS Secure internet connection via a SMS passcode, servers are disconnected from the production network; All log files are saved Efficient use allows currently for simultaneous users The researcher cannot copy or transfer any data to be taken out or to be inserted into of the system Output checking takes place always In institutes, 104 researchers and 42 projects served In institutes, over 150 researchers and 88 projects served Petteri BaerKiev 9-12 December

Rules related to the Remote access service In addition to user license, pledge of secrecy and agreement with the research project: Agreement on remote access with the research organization (annex of agreement: data security practices of organization) Contact person responsible for communication and user training Research organizations are responsible for their users To prevent the identification of individual enterprises and individuals, output is manually checked (sometimes even in two phases): before leaving Statistics Finland (always) and before the publication of the results (sometimes) Petteri BaerKiev 9-12 December

MIDRAS-remote access system Services that require permit Remote desktop for analysing data (programs and tools) Separated server space for data and metadata Output service for results, Input service for researcher’s data Services that require permit Remote desktop for analysing data (programs and tools) Separated server space for data and metadata Output service for results, Input service for researcher’s data Services that require registration Centralized digital permit application service Services that require registration Centralized digital permit application service Public services Data catalogue Helpdesk for research and tuition Public services Data catalogue Helpdesk for research and tuition Interface service for data and meta data, Administration services for user rights Organiza- tion A Organiza- tion C Organiza- tion E - Commonly agreed metadata standards – Data warehouse - Archive of multiple user files Researcher Organiza- tion B Organiza- tion D Pseudonymization Marianne Johnson/Research Services

 Statistics Finland’s remote access system (operating)  MIDRAS (Microdata Remote Acces System) survey Funded by Ministry of Education and Culture  Vision: Through national remote access system the microdata of public authorities are easily, safely, cost-effectively and securily usable for research work  Proposal for a national project Finnish Microdata Access Services  Submitted by Statistics Finland and the National Archives, was accepted as a National Research Infrastructure.  Funding for planning work in 2014 granted; 2015  still ??  Planned microdata access services for researchers:  Remote Access system  Centralized digital research data permit application service  Metadata catalogue  Information and support service Petteri Baer Plans for a National Remote Access System Kiev 9-12 December

Thank you for your attention “Knowledge is of two kinds. We know a subject ourselves or we know where we can find information upon it” – Samuel Johnson August Petteri Baer