The experience of a National Statistical Institute after a law change: Estonia First Regional Workshop Microdata Access in European Countries ― Cooperation.

Slides:



Advertisements
Similar presentations
JOINT DEGREES The Experience of the ENIC and NARIC Networks Dr. E. Stephen Hunt Manager, USNEI and President, ENIC Network ECA Team II Conference Joint.
Advertisements

Science, research and development European Commission THE FIFTH FRAMEWORK PROGRAMME B. Magis ACT/campagneinfo/slides/AG/AG6/5FP/conparEN.ppt.
Eurostat T HE E UROPEAN PROCESS OF ENHANCING ACCESS TO E UROSTAT DATA A LEKSANDRA B UJNOWSKA E UROSTAT.
Statistical Disclosure Control (SDC) at SURS Andreja Smukavec General Methodology and Standards Sector.
BUILDING PARTNERSHIPS FOR ENERGY SECURITY
Implementation of the CoP in SLOVENIA Cooperation with data users Genovefa RUŽIĆ Deputy Director-General.
Census Data Archiving Seminar Presentation on Census Data Archiving: Confidentiality and Anonymizaton Ethiopia, Addis Ababa, 20-23rd September,2011 Etambuyu.
United Nations Expert Group Meeting on Revising the Principles and Recommendations for Population and Housing Censuses New York, 29 October – 1 November.
Eurostat M ODES OF ACCESS TO EU MICRODATA IN THE NEW LEGAL FRAMEWORK A LEKSANDRA BUJNOWSKA E UROSTAT S TATISTICAL OFFICE OF THE E UROPEAN U NION.
Session 4. Panel session: How useful is the notion of “circle of trust” concept ? A vision for the future. Maurice Brandt Destatis Germany 2ND EUROPEAN.
Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September 2011 Overview of Archiving of Microdata Session 4 United Nations.
FORMS OF COOPERATION BETWEEN NATIONAL STATISTICAL INSTITUTES AND DATA ARCHIVES Sebastian Kočar (ADP, UL) First Regional Workshop – Microdata Access in.
CES Task Force on Confidentiality and Microdata Tiina Luige UNECE Statistical Division Conference of European Statisticians UN Economic Commission for.
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
Accreditation practices at the Hungarian Central Statistical Office Zoltán Vereczkei Methodology Department Hungarian Central Statistical Office
Access to microdata in Europe P resented by Michel Isnard – Insee DwB Training Course, Barcelona, Jan
ENQA a key player in the European Higher Education Area Meeting of the Belarus University System representatives Minsk, March 2013 Josep Grifoll / Жузэп.
Configuration Management (CM)
Mara Cammarrota Italian National Institute of Statistics Development of Information System and Corporate Products, Information Management and Quality Assessment.
Leonardo da Vinci Partnerships: an opportunity to work together Italian National Agency for LLP - Leonardo da Vinci Sectoral Programme.
Concept of Transparency Platform Martin Reisner Junior Adviser, Transparency ENTSOG’s Transparency Workshop Brussels – 11 September 2012.
Access to official statistical micro data at the Statistical Office of the Republic of Slovenia and cooperation with the Slovenian Social Science Data.
Frameworks for the Access and Use of Administrative Data, With the Example of Current Practice in the UK Steven Vale Office for National Statistics UK.
Presenter: Silas Mulwah Organization:Kenya National Bureau of Statistics  th September 2013, United Nations Regional workshop on Data Dissemination.
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
Administrative procedures for microdata access at SURS October 2013.
Regional Workshop MICRODATA ACCESS IN EUROPEAN COUNTRIES – COOPERATION BETWEEN NATIONAL STATISTICAL INSTITUTES AND DATA ARCHIVES 2nd Regional Workshop.
Access to micro data in Europe P resented by Michel Isnard – Insee DwB Training Course, Paris, 19 February 2014.
Statistical data confidentiality and micro data in Albania
Access to microdata in Statistics Estonia First DwB European Data Access Forum Luxembourg, 28th March 2012 Tuulikki Sillajõe.
Information session first joint ERANID call (Task 5 DOW) Belgian Science Policy Office 30 September 2015.
Metadata management in National Statistical Institutes and researcher access: an example Zoltán Vereczkei Hungarian Central Statistical Office Methodology.
Work Session on Statistical Data Confidentiality Access to Statistical Data for Scientific Purposes Helsinki, Finland, 5 to 7 October 2015 Presentation.
Giving research access to official microdata through the facilities of a National Statistical Institute: INE in Portugal Jose A. PINTO MARTINS - D ISSEMINATION.
Access to microdata in the Netherlands: from a cold war to co-operation projects Eric Schulte Nordholt Senior researcher and project leader of the Census.
High-Level Forum on Strategic Planning for Statistics in Central Asia Countries Bishkek, Kyrgyz Republic, May 2006 Oleg Kara, Deputy Director General,
Training Workshop on Development of Core Statistical indicators for ICTs Tunisian Experience in ICT indicators Collection. Tunisian presentation June 2005.
Hallgrímur Snorrason National Statistical Committee of the Kyrgyz Republic The 7 th SPECA Project Group on Statistics Improving the Coherence of Economic.
Overview and challenges in the use of administrative data in official statistics IAOS Conference Shanghai, October 2008 Heli Jeskanen-Sundström Statistics.
Data Dissemination Conditions in the European Statistical System (ESS) UNECE, Warschau May 2009.
Experience of the Statistical Office of Estonia on launching user satisfaction surveys Anne Nuka Head of the Information and Marketing Service.
Joint UNECE/Eurostat work session on statistical data confidentiality October 2015 Helsinki, Finland Circle of trust Maurice Brandt DESTATIS.
UNSD/ NSCB Regional workshop on data dissemination & communication Manila, Philippines, June 2012 Promoting (survey) microdata dissemination policies:
Presented By Margaret Hellen Atiro Uganda Bureau of Statistics at the United Nations Regional Seminar on Census Data Archiving 20 – 23 Sep 2011, Addis.
From Intrastat to SIMSTAT and ESS.VIP Programme ESTAT Walter Radermacher.
Researchers’ Usage of Microdata The example of Statistics Finland Advanced presentation – Some additional details Consultation Mission on Promoting the.
Role of Marketing in data dissemination Birgit Hansson Statistics Estonia
Estonian experience in implementation and maintenance of statistical database using PX-Web Eda Fros Statistics Estonia UNECE Workshop on Developing Data.
Administrative Data and Official Statistics Administrative Data and Official Statistics Principles and good practices Quality in Statistics: Administrative.
The statistical act, its application and challenges BY ABERASH TARIKU ABAYE NATIONAL STATISTICAL DATA QUALITY AND STANDARDS COORDINATION DIRECTORATE DIRECTOR.
Privacy and ‘Big Data’: the European perspective Human Subjects’ Protections in the Digital Age: IRB, Privacy and Big Data Peter Elias, University of Warwick.
Introduction to Statistics Estonia Study visit of the State Statistical Service of Ukraine on Dissemination of Statistical Information and related themes.
Statistical Business Register Enterprise Groups in Latvia Sarmite Prole Head of Business Register Section Business Statics Department Central Statistical.
Mirjana Boshnjak Skopje, 20 to 22 September 2017
PRESENTATION OF MONTENEGRO
Data Accessibility, Confidentiality and Copyright United Nations Statistics Division Demographic Statistics Section.
Quality assurance in official statistics
Implementing the ESS Vision 2020
OECD Chief Statistician and Director, Statistics Directorate
Ten years of centralised data collection
Ag.no.14.1 Dissemination of A65
ESS Vision 2020.
NTTS 2009 conference Tuulikki Sillajõe
Point 6. Eurostat plans for Time Use Survey data processing and dissemination Working Group on Time Use Surveys 10 April 2013.
Item 2.2 of the Agenda Remote access to confidential data for researchers: possible actions under the 7th Framework Programme Pascal JACQUES Unit B 5 15.
Integrated Statistical Systems
Statistical Office of the Republic of Slovenia and microdata for research Tomaž Smrekar.
Services for users based on user needs
Towards Census 2021 in Hungary
ESS Vision 2020.
Presentation transcript:

The experience of a National Statistical Institute after a law change: Estonia First Regional Workshop Microdata Access in European Countries ― Cooperation Between National Statistical Institutes and Social Science Data Archives Tuulikki Sillajõe

Contents Current legal framework and changes that the new law has brought Results of the researchers’ satisfaction survey Further challenges Microdata Access in Estonia

Legal basis for microdata access The Official Statistics Act is in force since Aug The Official Statistics Act Procedure for access to microdata for scientific purposes established by Director General of Statistics Estonia (SE). Procedure for access to microdata for scientific purposes Microdata are allowed to be used for research purposes only by legal persons or agencies, but not by freelance natural persons. Students pursuing a Master’s or Doctor’s degree are also considered researchers. The same rules apply to domestic and foreign researchers Microdata Access in Estonia

Decision process A legal person or agency in need of microdata for research purposes must submit a written application to the producer of official statistics.application Applications are considered by the Confidentiality Council (an internal body of SE). In case the application was satisfied, SE shall enter into an agreement with the legal person having submitted the application. Confidentiality commitments are signed by each researcher mentioned in the agreement Microdata Access in Estonia

Rules for making the decision In case of every requested data set, the Confidentiality Council shall consider two aspects:  risk of identifying a statistical unit;  the impact that the identification of a statistical unit may have (sensitivity of data). If the identification risk and sensitivity are rated as high, confidential data can be used only in a safe centre, by remote access or remote execution If both aspects are rated as low, the data applied for can also be delivered on removable devices Microdata Access in Estonia

Modes of access Safe centre Remote execution (LISSY) Remote access Scientific use file on CD-ROM or via FTP-server Public use files on the web Order for information SAS, SPSS, STATA, R Microdata Access in Estonia

All data categories are available Social surveys Business data Censuses Also, data derived from administrative records and other databases may be disseminated for scientific purposes. Data that permit direct or indirect identification of a statistical unit can be equally disseminated for scientific purposes. No consent or permission of data supplier needed Microdata Access in Estonia

Microdata dissemination till 2010 Business microdata were extremely rarely accessed and not available at all for some years. Microdata allowing the identification of a natural person could be accessed for scientific purposes without the person’s consent. In practice, there were few agreements with some major universities. Practices and communication about them were very diverse, but accepted and appreciated by researchers who happened to know about them and were thus able to use the service Microdata Access in Estonia

Major changes since 2010 Switch from institution-based agreements to project-based agreements Introduction of confidentiality commitments Equal access and transparent procedure for researchers Direct link between micodata used and research published ( SE stores all microdata disseminated for 25 years in the form they were made available for a particular research More categories of microdata are available A slight rise in the use of microdata by researchers Microdata Access in Estonia

Progress made, ‒ YearApplications rejectedcancelled Agree- ments maderemote access or use of safe centre dissemi- nation on remo- vable devices Total Microdata Access in Estonia

User satisfaction survey 04.– Target group — researchers mentioned in agreements for remote access or use of safe centre (both: finished and valid agreements), 51% of them had used the service Data collection method — CAWI Response rate — 39%, whereas 50% of these had used the service 33% of respondents had not used the service, mainly because actual data processing was done by other members of the project team (one respondent considered it unhandy) Microdata Access in Estonia

Users of remote access or safe centre 67% of respondents had used remote access or safe centre. How did you get information about the availability of the service? 55% from colleagues 32% from elsewhere 18% from SE The majority had used remote access (86%). The following slides concern only these 67% of respondents. Microdata Access in Estonia

Application procedure Microdata Access in Estonia Average rating — 9.1 X — not personally involved in the process, because it was done by another member of the research team (23% of respondents) Assessment on 10-point scale

Speed of access to microdata Microdata Access in Estonia Average rating — 8.3 X — not personally involved in the process, because it was done by another member of the research team (23% of respondents) Assessment on 10-point scale

Satisfaction with … Microdata Access in Estonia Average rating — 7.9

IT resources of the workstation Microdata Access in Estonia Average rating — 6.1 Assessment on 10-point scale

Promoter index Microdata Access in Estonia Net Promoter Score — 68 (An NPS that is higher than zero is considered good and an NPS of 50+ is considered excellent)

Lessons learned There is no point in reinventing the wheel. Supply creates demand — a clear and quick procedure enhances access. Offer as good a service as you can. The aim of SE was to widen the reuse of the microdata collected for production of official statistics. But, at the beginning, SE still gained a kind of negative image as an impeder of research. Communication with stakeholders and interest groups is essential. Collect facts Microdata Access in Estonia

Researchers’ satisfaction could be increased by… upgrading Office 2003 software to allow faster processing of large amounts of data in Excel and Access; upgrading VPN (virtual private network) software which does not work with Windows 7 and Windows 8 now; improving the written instructions on how to install VPN and use the workstation; informing about the possibility to have additional packages of R installed by the IT-staff of SE; informing researchers if the checking of the results of their research takes up to three days (i.e. not available on the same day); improving metadata (adding information on sampling) Microdata Access in Estonia

Thank you for your attention! Microdata Access in Estonia