1 1 Using traditional control systems to reveal changes when introducing new data collection instruments Sindre Børke Senior Adviser Division.

Slides:

Advertisements

Similar presentations

Statistical Information Management Program (SIMP II) By Roger Jullion (Statistics Canada) OECD/NBS Workshop on National Accounts Haikou, China December.

Advertisements

1 Training Issues Partially adapted from Multiple Indicator Cluster Surveys (MICS) Regional Training Workshop – Field Staff & Training Issues, Unicef.

The 4 th International Workshop on Internet Survey Methods Statistical Center in Deajeon, Korea, September 2012 Ken Hoshino Statistics Bureau, Ministry.

Do Economic and Demographic Characteristics Differ between Web and Mail Respondents to the 2005 Census of Agriculture Content Test? By Nancy J. Dickey.

Copyright 2010, The World Bank Group. All Rights Reserved. Statistical organization Principles and models Part 1 Strengthening Statistics Produced in Collaboration.

International Conference on Establishment Surveys 1 Everything you wanted to know about Electronic Data Reporting (EDR) at Statistics Canada June 2007.

Session 3: Summary of Business Profiling Wiesbaden Group Paris 24 – 27 November 2008.

Teacher’s Notes This sequence of slides is designed to introduce, and explain the taking of measurements, including the meaning of variation, range, mean.

Integrating a Gender Perspective into Time Use Statistics.

Information system for the Swedish Accommodation Statistics Sara Frankl, Statistics Sweden Marketing Manager at the unit “Travellers and Tourism” tfn:

Building Web Collection Capability for ONS Social Surveys Fiona Dawe and Laura Wilson.

1 Continuous improvement and Lean thinking in Statistics Norway Anne Sundvoll, Director Department of data collection and methods Grete Olsen,

Collecting Quantitative Data

INTERPRET MARKETING INFORMATION TO TEST HYPOTHESES AND/OR TO RESOLVE ISSUES. INDICATOR 3.05.

Chapter 10 Collecting Quantitative Data. SURVEY QUESTIONNAIRES Establishing Procedures to Collect Survey Data Recording Survey Data Establishing the Reliability.

Mainstream Enterprise Statistics Richard McMahon Head of STS Division Central Statistics Office, Ireland.

1 Report on the Income- and Product-Side Estimates of Output Growth Comments Steve Landefeld Brookings Panel on Economic Activity March 19,

Data Management: Documentation & Metadata Types of Documentation.

Questionnaire Designing Developing the best instrument to collect data for your research.

ELECTRONIC DATA COLLECTION SYSTEM Howard Hamilton.

1 Constructing and Maintaining a Business Register: Singapore’s Experience By Ong Lai Heng Singapore Department of Statistics International Workshop on.

Using survey data collection as a tool for improving the survey process Silvia Biffignandi, Antonio Laureti Giulio Perani University of Bergamo Istat Istat.

Using Software to Collect Data Electronically for the Economic Census Amy E. Anderson & M. Diane Harley Presented by: Shirin Ahmed U.S. Census Bureau.

PDAs for Data Collection in Resource-Poor Settings Project HOPE’s experience.

Teacher’s Notes This sequence of slides is designed to introduce, and explain the taking of measurements, including the meaning of variation, range, mean.

A Remarkable Record of Science for Change Since 1967.

Prime Esperienze di Utilizzo di R all’Interno dell’Istat The Web-Based Information System of Italian Population Census Maura Giacummo Leonardo Tininini.

Accelerating the Centralisation of Data Collection at the Australian Bureau of Statistics Jenine Borowik, Adrian Bugg, Bruce Fraser Program Delivery Division,

Second International Workshop on Economic Census Seoul, Korea, 6 -9 July 2009 Shanker Lal Shrestha Central Bureau of Statistics Nepal Data Collection and.

Challenges in Collecting Police-Reported Crime Data Colin Babyak Household Survey Methods Division ICES III - Montreal – June 20, 2007.

European Conference on Quality in Official Statistics Session 26: Quality Issues in Census « Rome, 10 July 2008 « Quality Assurance and Control Programme.

The Nature of Crime and Victimization Chapter 2.  Primary sources for measuring crime are:  Official Data (Uniform Crime Reports)  Victim Surveys (National.

The Experiences of Web Based Data Collection from Enterprises in Finland August 9th 2006, JSM Seattle USA.

Electronic data collection system eSTAT in Statistics Estonia: functionality, authentication and further developments issues 4th June 2007 Maia Ennok,

1 1 Indicators for Managing and Improving the Data Collection Process Sindre Børke and Jonas Dahl, Division for Data Collection Methods, Statistics Norway.

1 1 Independency and ethical issues. New challenges after the reshaping of official statistics and use of smart data. By Olav Ljones Statistics Norway.

Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.

CES Discussion on Internet Data Reporting. EDR discussion AgencySurvey Environment Statistics Finland 94% of gross data derived from admin sources 1%

1 1 Towards a More User-friendly Reporting System for KOSTRA - Municipality-State-Reporting in Norway By Trine Dale, Bente Hole and Tore Nøtnæs Statistics.

Editing of linked micro files for statistics and research.

The usage of a data capture tool in statistical surveys on enterprises Rossana Balestrino, Patrizia Larese Istat - Via C. Balbo Roma - Italy.

Web based tools for Raw Data collection Bertrand Loison, Chief Information Officer (CIO) Eurostat / IT Directors Group / / Luxembourg Swiss.

Marketing Research Approaches. Research Approaches Observational Research Ethnographic Research Survey Research Experimental Research.

Designing Interactive Edits for U.S. Electronic Economic Surveys and Censuses: Issues and Guidelines Elizabeth M. Nichols, Elizabeth D. Murphy, Amy E.

CES Seminar on “Organization of data collection and sharing, and the management challenges for the implementation of SDMX” Session 1 Hank Hermans CES /

Copyright 2010, The World Bank Group. All Rights Reserved. Testing and Documentation Part II.

The System Life Cycle The systems lifecycle is the set of stages that are followed when developing an information system.

McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. A PowerPoint Presentation Package to Accompany Applied Statistics.

S T A T I S T I K A U S T R I A May Wolfgang Koller May 2004 © STATISTIK AUSTRIA i n f o r m a t i o n Moving Saving Time And Money:

RECENT DEVELOPMENT OF SORS METADATA REPOSITORIES FOR FASTER AND MORE TRANSPARENT PRODUCTION PROCESS Work Session on Statistical Metadata 9-11 February.

1 Panel debate IRES-ESCM and SEEA Olav Ljones Oslo Group Canberra, May

Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries 3-5 February 2014, Castries,

Trying to improve editing tasks through EDR methods Pedro Revilla, Ignacio Arbués, Margarita Gonzalez and Isabel Yun National Statistical Institute, Spain.

Service Level Agreements White Paper - A Summary Quality of Service Task Force The Open Group Presented by: Jon Saperia

Use of rental equivalence method in CPI CPI workshop Istanbul, 10 – 13 October 2011.

1 Using Household Surveys to Collect Data on Remittances: Lessons Learned from the CPS Migration Supplement Elizabeth M. Grieco Chief, Immigration Statistics.

The Dutch travel survey Mixed-mode experiences from the Netherlands Ilona Bouhuijs Netherlands Statistics June 17th 2013 Disclaimer: the views expressed.

Topic (i): Editing nearer the source Work Session on Statistical Data Editing Vienna, Austria April 2008.

ESSnet project "Automated data collection and reporting in accommodation statistics" Objectives, achievements and results Köln,

Managing Multi Mode Collection Instruments in the 2011 UK Census Frank Nolan, Heather Wagstaff, Ruth Wallis Office for National Statistics UK.

Workshop on Passenger Mobility Conclusions. EU data requirements – DG MOVE  Environmental, economic and social considerations require close monitoring.

Development of ICT Statistics - The Experience of Hong Kong, China Census and Statistics Department (C&SD)

Copyright 2010, The World Bank Group. All Rights Reserved. Producer prices, part 2 Measurement issues Business Statistics and Registers 1.

Administrative Data and Official Statistics Administrative Data and Official Statistics Principles and good practices Quality in Statistics: Administrative.

Jordan Population and Housing Census 2015 Prepared by: Ahmad Mowafi

EDR impacts on editing Summary

Use of handheld electronic devices for data collection in GeoStat

The Computer-Assisted Personal

„Elektra” HCSO electronic survey and its background

Indicator 3.05 Interpret marketing information to test hypotheses and/or to resolve issues.

Presentation transcript:

1 1 Using traditional control systems to reveal changes when introducing new data collection instruments Sindre Børke Senior Adviser Division for Data Collection Methods, Statistics Norway

2 Information model (survey definitions) Web- solution Web questionnaire Paper questionnaire Survey database Data from web questionnaires Data from paper questionnaires Editing Process Paper contra web Questionnaires

3 Outsourced editing gives better data Household census: average 6,2 and 3,4 errors Hotel statistics: average 1.7 and 0.7 errors Hotels, prize per room: 41% contra 36% with error

4 Without controls, more errors in web? Not in household census 2001 Hotels, number of rooms let out: 12% contra 18% error (PPI: 1.27% contra 1.40% outside the defined range) Road goods transport: Different patterns to be explained

5 Behind – or on - the screen Following the respondent’s filling-in process, and the warnings presented during this process

6 Errors in incoming web and paper version of the hotel statistics questionnaire

7 Errors detected in the web and paper version of the hotel statistics questionnaire One error message More error messages One error message More error messages

8 Information model (survey definitions) Supporting software Basic software Individual adaptions Enterprise database Web- solution Web questionnaire Paper questionnaire Survey database Data from Enterprise system Data from web questionnaires Data from paper questionnaires Editing Process Transfer of electronic data

9 Allready in wide use for accounts and salary data in Norway. Presents challenges in development and upkeeping –Supporting software from the software vendors –Individual adaptions at the respondent’s Looking into one case with traditional controls, finding better results than from paper questionnaires Requires different control/editing, due to different set of possible errors and different consequences when errors occurs

10 In short: Few surveys seems to have data to observe possible changes in quality Those data we find seem to tell that there are changes Possible changes in data that are not part of a control can not be revealed with the instrument we use in this paper This field must be further investigated, and give feed-back/- forward to the editing procedure and to questionnaire developing