Increasing motivation for better reporting in establishment surveys Mojca Bavdaž, University of Ljubljana, Slovenia Johan Erikson & Boris Lorenc, Statistics.

Slides:

Advertisements

Similar presentations

1 A review of Evaluation and Impact Assessment by DAC Heads of Information in 2006 Ida Mc Donnell Annual Meeting of DAC HoI Canberra May 2006.

Advertisements

The Response Process Model as a Tool for Evaluating Business Surveys Deirdre Giesen Statistics Netherlands Montreal, June 20th 2007 ICES III.

Towards a Better Integration of Survey and Tax Data in the Unified Enterprise Survey Claude Turmelle Statistics Canada ICES-III Montréal, Québec, Canada.

ENBES Steering Committee report Past Initiated in 2008 i. create network of European researchers and practitioners in establishment statistics.

Mixed-Mode Experiments Rachel Vis, Statistics Netherlands QUEST Ottawa, April 2007.

1 F/LOSS User Survey & Firms‘ Open Source Activities Dr. Thorsten Wichmann Berlecon Research GmbH Berlin, Germany Presented by Ruediger Glott, International.

Session 3: Summary of Business Profiling Wiesbaden Group Paris 24 – 27 November 2008.

Current issues and trends in bibliographic control Overview of the Division’s interests and activities Bibliography Section Bohdana Stoklasova, Chair Talbott.

Information system for the Swedish Accommodation Statistics Sara Frankl, Statistics Sweden Marketing Manager at the unit “Travellers and Tourism” tfn:

Thursday, 10 July, 2008Q2008, 8-11 July 2008, Rome1 Getting Data for Business Statistics: A Response Model for Business Surveys Ger Snijkers Statistics.

The Complete Design Data Collection Methods Part Three.

© John M. Abowd 2005, all rights reserved Sampling Frame Maintenance John M. Abowd February 2005.

Challenges in designing mixed mode in business surveys Dr Mojca Noc Razinger, Statistical Office of the Republic of Slovenia.

Introduction of Internet Survey Methodology to the Emirate of Abu Dhabi Andrew Ward, Maitha Al Junaibi and Dragica Sarich.

How to Assess Student Learning in Arts Partnerships Part II: Survey Research Revised April 2, 2012 Mary Campbell-Zopf, Ohio Arts Council

Information system for the Swedish Accommodation Statistics Sara Frankl, Statistics Sweden Marketing Manager at the unit “Travellers and Tourism” tfn:

1 1 Web and Paper Questionnaires seen from the Business Respondent’s Perspective Gustav Haraldsen, Statistics Norway Jacqui Jones, UK Office of National.

THE CRIME AND JUSTICE SURVEY Research, Development and Statistics BUILDING A SAFE, JUST AND TOLERANT SOCIETY Tracey Budd.

RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road ■ P.O. Box ■ Research Triangle Park, North Carolina, USA

MANAGEMENT OF MARKETING

Deirdre Giesen & Ger Snijkers EESW 9-11 September 2013 Communication with businesses and response burden.

Paulo Saraiva dos Santos Data Collection Department « Scanner Data Workshop 7-8 June 2012 Stockholm, Sweden Scanner Data Project The experience of Portugal.

Fourth Joint EU-OECD Workshop on Business and Consumer Opinion Surveys EU-wide business survey in the financial service sector Brussels, 12th October 2009.

Recruiting the Mentors Activities and Timescales Kulvinder Birring Brunel university.

Deirdre Giesen & Barbara Berkenbosch Managing perceived response burden: why and how.

Communication strategy to reduce non-response in enterprise surveys at the Statistical Office of the Republic of Slovenia Paper by: Eva Belak and Mojca.

Adding a Mode as a Final Step in the Follow-up of a Panel Survey Seminar on New Frontiers for Statistical Data Collection Geneva, Switzerland, 31 October.

ICES III - Johan Erikson1 Effects of offering web questionnaires as an option in enterprise surveys – The Swedish experience Johan Erikson Statistics Sweden.

Nonresponse issues in ICT surveys Vasja Vehovar, Univerza v Ljubljani, FDV Bled, June 5, 2006.

1 Using Focus Groups to Improve Response in Monthly Surveys Author: Lisa Houlihan U.S. Census Bureau Presenter: Anne Russell U.S. Census Bureau.

1 National Job Vacancy Surveys: The Same or Still Different? Anja Kettner and Michael Stops Institute for Employment Research, Nuremberg (Germany) European.

12th Meeting of the Group of Experts on Business Registers

Comparing approaches of different (partly) register-based countries Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics.

The Problem of Measuring E-resources *) Robert Hayes 1, Karin Karlics 2, Christian Schlögl 2 2 University of Graz Institute of Information Science and.

1 Your skills and experience are a valuable resource to your department and to the City of Houston. The purpose of this presentation is to refresh your.

Understanding the Decision to Participate in a Survey and the Choice of the Response Mode Anders Holmberg and Boris Lorenc European Conference on Quality.

Human Resource Management and Planning A critical responsibility for leadership Part 1.

100 years of the UK Census of Production Paul Smith and Stephen Penneck Office for National Statistics.

Short-Term Economic Statistics Working PartyJune Short Term Economic Statistics Timeliness Framework Richard McKenzie OECD.

A Strategy for Prioritising Non-response Follow-up to Reduce Costs Without Reducing Output Quality Gareth James Methodology Directorate UK Office for National.

Eurostat Data collection. Presented by Johan Erikson Statistics Sweden.

Electronic Questionnaire Collection at Statistics Canada Milana Karaganis Marc St-Denis.

Measuring entrepreneurship - the European approach OECD Entrepreneurship Indicators Project Expert Workshop 26-27/10/2005 Peter Bøegh Nielsen, Hartmut.

Development of Electronic Data Reporting (EDR) in Statistics Finland.

WP3 UK sample 46 teacher/trainer questionnaires ICT learner group of 10 - focus group Bath Chamber of Commerce discussions (300 members) Connexions West.

Thursday, June 21, 2007ICES3, June 18-21, 2007, Montreal1 Understanding the Decision to Participate in a Business Survey Ger Snijkers Martin Luppes Barbara.

Recruitment and Development at Statistics Canada Connie Graziadei Director General Human Resources Branch Workshop of Human Resources Management and Training.

Overview of measures used by NSIs to reduce response burden Conference on Administrative Simplification in Official Statistics, SIMPLY 2010 Virginie Raymond-Blaess.

Q Rome Italy, July The Mysterious 36% Difference: Studies on a Measurement Error Anette Björnram, Boris Lorenc, Andreas Persson, Klas Wibell.

Turnover for the Commercial and Industrial Machinery Repair and Maintenance Sector in Sweden Johan Åhman

Dependent Data Collection in ONS Business Surveys Jacqui Jones Methodology Directorate Office for National Statistics.

CES Seminar on “Organization of data collection and sharing, and the management challenges for the implementation of SDMX” Session 1 Hank Hermans CES /

4th Quality Conference (4QC) Impact Assessment Study Rui Sousa, PhD Catholic University of Portugal Lisbon, 16 July 2007.

The Art of Letter Writing. In Context Assess your abilities. Research & evaluation jobs. Define your objectives.

Do Monetary Incentives Increase Business Survey Response Rates? Results from a Large Scale Experiment Paul Biemer, RTI International and University of.

Record Keeping Studies – Love ‘Em or Leave ‘Em National Science Foundation Division of Science Resources Statistics International Conference on Establishment.

SHRM Poll – Social Networking Websites and Recruiting During Financially Challenging Times October 24, 2008.

Quarterly and monthly establishment surveys International Workshop on Industrial Statistics Beijing, China, 8-10 July 2013.

Open Book Accounting In Adult Services within the Birmingham Social Care Market 21 January 2015 Jennet Hartrick- BCC Charlie Whitworth- KPMG.

Data Collecting Techniques Telephone interviews Traditional telephone interviews involve phoning a sample of respondents and asking them a series.

1 Make it happen! Session Overview * Top Tips for: Disclosure, Inherent Requirements Resume Graduate Applications Interviews Answering Your Questions *(Session.

Component D: Activity D.3: Surveys Department EU Twinning Project.

1 Data collection. 2 Recommended steps Send a pre-card (or make a telephone call) informing the subject that they will be receiving the questionnaire.

Using Surveys to Design and Evaluate Watershed Education and Outreach Day 5 Methodologies for Implementing Mailed Surveys Alternatives to Mailed Surveys.

M O N T E N E G R O Negotiating Team for Accession of Montenegro to the European Union Working Group for Chapter 18 – Statistics Bilateral screening: Chapter.

Anna Długosz Central Statistical Office of Poland

Gustav Haraldsen, Ger Snijkers, Elisabeth Falnes-Dalheim

Deirdre Giesen & Barbara Berkenbosch

PRODCOM SURVEY IN THE UNITED KINGDOM

PRODCOM Working Group JMO M November 2012

Presentation transcript:

Increasing motivation for better reporting in establishment surveys Mojca Bavdaž, University of Ljubljana, Slovenia Johan Erikson & Boris Lorenc, Statistics Sweden Ger Snijkers, Statistics Netherlands ENBES Session Data Collection Challenges in Establishment Surveys

Total Business Survey Burden Model  How to influence business’ response behaviour in practice?

Study Designs

StudyData collection covered in the study Sweden I. Annual Survey of Occupations (mainly small units, rotating every 4-5 years – a thick booklet included) Sweden II. Annual Structural Business Survey (non-responding units with a shorter questionnaire, not the largest) Slovenia Annual Industry Survey (min 20 employees; long if many different products – a thick booklet included) Monthly Survey on Turnover in Service Activities (short; largest units in every service activity group) Netherlands Semi-annual Investment Expectations Survey Quarterly Survey on Jobs & Absenteeism Context

StudyData collection covered in the study Sweden I. Annual Survey of Occupations (mainly small units, rotating every 4-5 years – a thick booklet included) Sweden II. Annual Structural Business Survey (non-responding units with a shorter questionnaire, not the largest) Slovenia Annual Industry Survey (min 20 employees; long if many different products – a thick booklet included) Monthly Survey on Turnover in Service Activities (short; largest units in every service activity group) Netherlands Semi-annual Investment Expectations Survey Quarterly Survey on Jobs & Absenteeism Context

StudyData collection covered in the study Sweden I. Annual Survey of Occupations (mainly small units, rotating every 4-5 years – a thick booklet included) Sweden II. Annual Structural Business Survey (non-responding units with a shorter questionnaire, not the largest) Slovenia Annual Industry Survey (min 20 employees; long if many different products – a thick booklet included) Monthly Survey on Turnover in Service Activities (short; largest units in every service activity group) Netherlands Semi-annual Investment Expectations Survey Quarterly Survey on Jobs & Absenteeism Context

Images courtesy of akeeris and stockimages / FreeDigitalPhotos.net

StudyData collection covered in the study Sweden I. Annual Survey of Occupations (mainly small units, rotating every 4-5 years – a thick booklet included) Sweden II. Annual Structural Business Survey (non-responding units with a shorter questionnaire, not the largest) Slovenia Annual Industry Survey (min 20 employees; long if many different products – a thick booklet included) Monthly Survey on Turnover in Service Activities (short; largest units in every service activity group) Netherlands Semi-annual Investment Expectations Survey Quarterly Survey on Jobs & Absenteeism Context

Introduction Shorter Reference to new website for businesses Headings More directly referring to respondent’s task (e.g. What we ask you to do) Tone Friendlier; mandatory status and fines stressed more in the reminder letter

Timing of Studies Sweden I. Sweden II. Slovenia Netherlands Spring Letter & Booklet exp. Autumn Repeated exp. November Reminder exp. January-February Follow-up on Autumn exp. January−May Monthly Survey exp. February−March Annual Survey exp. January Follow-up evaluation June Follow-up evaluation June Follow-up evaluation Sept−October Letter evaluation July−October Letters sent

Results

Study ?? Sweden I. Letter  Booklet & Paper qnr Sweden II. Letter  Slovenia Call & Text  Post-it  Combined in the Annual Survey Experimental results

Sweden I. Booklet & Qnr  ? Letter 

What went wrong? Step-by-step evaluation Did we reach businesses? Accounting firms working for SMEs. Did we reach respondents? Contact details. Did our treatments get the chance? Envelope. Ignoring accompanying material. Scanning for essential information. Did our treatments produce effect? Very few, opposite to expectations. Timing? Image courtesy of Stuart Miles / FreeDigitalPhotos.net Business

Evaluation findings Difficult to produce an effect, especially a long-lasting effect: few claimed to have noticed the change even fewer recalled anything about the change exceptionally they made an extra effort (e.g. website visit, statistics download) Common explanations about (particular) official statistics: no time to investigate interesting but no value for the business useful for others in the business, especially if more detailed and tailored to the branch A telephone call was more appreciated in long complex survey.

Lessons and future research Letters seem: unable to change response behaviour still important for providing essential information (due date, login details) Other forms of communication seem to have more potential. Minor treatments seem inefficient on previously sampled establishments and “professional” respondents with routinised behaviour. Important to target newly sampled establishments and novice respondents. We still need to better understand what the majority of businesses perceive as having value for their own business.

We hope to see you at … European Network for Better Establishment Statistics The fourth European Establishment Statistics Workshop, EESW15, Poznań, Poland, September 2015