© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Business Surveys – Testing Strategies in.

Slides:

Advertisements

Similar presentations

Quality at Statistics Austria Conference on Data Quality for International Organizations Helsinki, 6-7 May 2010 © STATISTIK AUSTRIA Thomas.

Advertisements

© Federal Statistical Office of Germany, Sections Human Resources Development and Questionnaire Pretesting, Data Collection Methods Upward feedback at.

ISIC and CPC Maintenance and Revision Policies Expert Group Meeting May 18-20, 2011.

Brian A. Harris-Kojetin, Ph.D. Statistical and Science Policy

Customer Satisfaction Performance Measures Workgroup Final Report.

Designing the Questionnaire

Results and next steps from the ESSnet Admin Data Alison Pritchard Business Outputs & Developments, Office for National Statistics, UK 4 December 2012.

CZECH STATISTICAL OFFICE | Na padesatem 81, Prague 10 | Jitka Prokop, Czech Statistical Office SMS-QUALITY The project and application.

Evaluation is a professional and ethical responsibility and is a core part of PHN professional practice Commitment to evaluation helps build the PHN intelligence.

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt DESAP - A New Self Assessment Checklist.

Quality Improvement Prepeared By Dr: Manal Moussa.

1 1 Web and Paper Questionnaires seen from the Business Respondent’s Perspective Gustav Haraldsen, Statistics Norway Jacqui Jones, UK Office of National.

Seminar on Developing a Programme on Integrated Statistics in the Caribbean Saint Lucia The Components of an Integrated Business and International Statistics.

Developing Business Data Collection and measuring Response Burden European Conference on Quality in Official Statistics Helsinki 4-6 May 2010 Johanna Leivo,

9: Designing the Questionnaire. 9-2 Copyright © 2008 by the McGraw-Hill Companies, Inc. All rights reserved. Hair/Wolfinbarger/Ortinau/Bush, Essentials.

Development of Evaluation Instruments based on ICT Skills Standards for Teachers (ISST) 7th May, 2014.

Eurostat Repeated surveys. Presented by Eva Elvers Statistics Sweden.

Diane K. Willimack U.S. Census Bureau Any views expressed on statistical, methodological, or technical issues are those of the authors and not necessarily.

Using survey data collection as a tool for improving the survey process Silvia Biffignandi, Antonio Laureti Giulio Perani University of Bergamo Istat Istat.

Puppy Rearing Best Practice The Puppy Walking Development Project David Grice Operations Project Manager.

Professional Development Activity Log: Comparing Teacher Log and Survey Approaches to Evaluating Professional Development AERA Annual Meeting Montreal,

Giovanna Brancato, Marina Signore Istat Work Session on Statistical Metadata (METIS) Metadata and Quality Indicators Reuse for Quality reporting Geneva,

FAEIS Project User Opinion Survey 2005 Thursday, June 23, 2005 Washington, D.C. H. Dean SutphinYasamin Miller ProfessorDirector, SRI Agriculture & Extension.

1 Workshop on Informal Employment and Informal Sector Data Collection: Strategy, Tools and Advocacy Amman, April 2008 Phase2: Sample design, measurement.

13-Jul-07 Results of the vignettes on the test of a new definition of enterprises.

Slide 1 D2.TCS.CL5.04. Subject Elements This unit comprises five Elements: 1.Define the need for tourism product research 2.Develop the research to be.

Copyright © 2007 Pearson Education Canada 3-1 Marketing Research Marketing research serves many roles. It can: 1.Link companies with customers via information.

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic Strengthening Statistical Capacity to Improve MDG Data in Conditions.

© Federal Statistical Office (FSO), Institute for Research and Development in Federal Statistics Slide 1 Quality of Pretesting: Instruments for Evaluation.

Methods of Media Research Communication covers a broad range of topics. Also it draws heavily from other fields like sociology, psychology, anthropology,

S7: Audit Planning. Session Objectives To explain the need for planning To explain the need for planning To outline the essential elements of planning.

1 Measuring the Agriculture indicators in South Africa Presentation to the ICAS IV 2007 conference delegates Lessons learned from the 2002 Census of Commercial.

Eurostat Overall design. Presented by Eva Elvers Statistics Sweden.

Learning From Assessment: Evaluating the Benefits of DALI (Diagnostic Assessment Learning Interface) Hershbinder Mann & Guinevere Glasfurd-Brown, University.

Audit Planning. Session Objectives To explain the need for planning To outline the essential elements of planning process To finalise the audit approach.

African Centre for Statistics United Nations Economic Commission for Africa Session 9: Dissemination of Environment Statistics Workshop on Environment.

Short-Term Economic Statistics Working PartyJune Short Term Economic Statistics Timeliness Framework Richard McKenzie OECD.

CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 1 Subsystem QUALITY in Statistical Information System Czech.

Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.

© Federal Statistical Office Germany, Division IB, Institute for Research and Development in Federal Statistics Sheet 1 Surveys, administrative data or.

Copyright 2010, The World Bank Group. All Rights Reserved. Principles, criteria and methods Part 2 Quality management Produced in Collaboration between.

Survey Methodology Survey Instruments (1) EPID 626 Lecture 7.

Implementation of the European Statistics Code of Practice Yalta September 2009 Pieter Everaers, Eurostat.

Research Methodology For AEP Assoc. Prof. Dr. Nguyen Thi Tuyet Mai HÀ NỘI 12/2015.

United Nations Oslo City Group on Energy Statistics OG7, Helsinki, Finland October 2012 ESCM Chapter 8: Data Quality and Meta Data 1.

Fashion MARKETING TID1131. Market Research Understanding Secondary & Primary research Understanding Quantitative & Qualitative research.

© Statistisches Bundesamt, Division IB, Institute for Research and Development in Federal Statistics Is the utilization of administrative data in short.

Expert Group Meeting on the Revision of the Handbook on the Management of Population and Housing Censuses New York, 14 – 17 December 2015 Overview of the.

Short-Term Economic Statistics Working PartyJune Short Term Economic Statistics Timeliness Framework Richard McKenzie OECD.

China ’ s Input-Output Survey and Its Tabulation Method QI Shuchang Dept. of National Accounts, NBS.

Census quality evaluation: Considerations from an international perspective Bernard Baffour and Paolo Valente UNECE Statistical Division Joint UNECE/Eurostat.

1Your reference The Menu of Indicators and the Core Set from the South African Point of View Moses Mnyaka 13/08/2009.

1. 2 Issues in the Design and Testing of Business Survey Questionnaires: Diane K. Willimack U.S. Census Bureau Economic Census The International.

Survey Training Pack Session 3 – Questionnaire Design.

1 European Statistics Code of Practice. I.Institutional Environment Principle II.Statistical processes Principle III.Statistical Output Principle.

Development of Gender Sensitive M&E: Tools and Strategies.

A Training Course for the Analysis and Reporting of Data from Education Management Information Systems (EMIS)

How to deal with quality aspects in estimating national results Annalisa Pallotti Short Term Expert Asa 3st Joint Workshop on Pesticides Indicators Valletta.

Good Laboratory Practice

AUDIT STAFF TRAINING WORKSHOP 13 TH – 14 TH NOVEMBER 2014, HILTON HOTEL NAIROBI AUDIT PLANNING 1.

United Nations Statistics Division

Compilation and Dissemination of Distributive Trade Statistics

The Inquiry on the Statistical Units

Survey phases, survey errors and quality control system

Sample surveys versus business register evaluations:

ADMINISTRATIVE DATA IN ANNUAL BUSINESS STATISTICS OF LATVIA

Survey phases, survey errors and quality control system

Organization of efficient Economic Surveys

Presentation transcript:

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Business Surveys – Testing Strategies in the FSO (GER) QUEST WORKSHOP 2007, Ottawa 23th-26th April Karen Blanke

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 2 Survey on Trade Statistics Sample size: enterprises Data collection mode: paper/pencil or electronical questionnaire, self-administered Topics: Structure and amount of employees Stock and purchase of goods Investment and subsidies Turnover of the financial year

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 3 Survey Form: Trade Statistics

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 4 Feedback on Trade Statistics: By the enterprises: Burdensome Useless – does not reflect reality Relevance of data By the public: Timeliness Inconsistency with other findings

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 5 Basic problems of business surveys: Availability of data (record formation) Willingness to participate Respondent selection Retrieval and judgement (knowledge of data sets and access) Reporting – (statistical and accounting categories) Authority to provide data

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 6 Testing principles: Aim of testing: No total revision Resources: 2 collaborateurs Focus: Check different perspectives of users Use what is available Focus on respondents‘ views

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 7 Conceptual frame of testing: Conceptual testing: Comparison of definitions (accounting system and official statistics) Quantitative methods: Evaluation of data sets Main Hotline requests Qualitative methods Discussions with experts and data entry staff Company-site-visits

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 8 Preliminary findings (I): Data sets: comparison raw data vs. final data: Highest rate of correction does not correspond with problems noticed by respondents Over and underestimation of corrections No evidence of the reason of unreliable data

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 9 Preliminary findings (II): Problems encountered via callbacks and hotline: Interrelated errors Implausible data Via hotline: case-specific problems, less general problems

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 10 Preliminary findings (III): Discussion with experts: Experts are quite convinced of their concepts They provide feedback on general concepts, need of specific items Provide helpful knowledge on organisational issues, layout aspects for data entry

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 11 Preliminary findings (IV): Discussion with data entry staff : Sensitive on layout issues Order and structure of questionnaire Accepted level of detail by respondents Check of interrelated errors

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 12 Preliminary findings (V): Company-site-visits : Companies are difficult to recruit and less is more Main problem: Companies are overloaded by surveys Not only companies are different but also the respondent in the companies Instructions are rarely in use; respondents prefer their own definitions However: Instructions and definitions are needed

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Folie 13 Discussion Relevance of quantitative and qualitative testing in business surveys What are the most helpful business survey testing methods? Recruitement of enterprises Laboratory tests in business surveys Aspects of visual design, e.g. 3 columns design (NL) Treatment of instructions (length, location )

© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Thanks for your attention