Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section B 1
Copyright 2010, The World Bank Group. All Rights Reserved. Nonresponse Prevention Grouping Front-end techniques Special reporting arrangements Follow-up techniques 2
Copyright 2010, The World Bank Group. All Rights Reserved. Front-End Techniques Advance notification Interviewer performance guidelines Questionnaire design Respondent incentives 3
Copyright 2010, The World Bank Group. All Rights Reserved. Special Reporting Arrangements Sample rotation in longitudinal surveys Short form questionnaires administered a subsample of long forms 4
Copyright 2010, The World Bank Group. All Rights Reserved. Follow-up Techniques Reminder cards and call backs Reinterview Periodic telephone calls 5
Copyright 2010, The World Bank Group. All Rights Reserved. Monitoring Data Collection Responses Number of contacts (interviews and noninterviews) by location Respondent sociodemographic characteristics Study effects of various prior contact schemes on cooperation rates Number of visits required before conversion of refusals 6
Copyright 2010, The World Bank Group. All Rights Reserved. Monitoring Data Collection Responses Using listing sheet for interviewer response rate notes Determine meaningful data for interviews and noninterviews Provide simplified interview outcome codes for use by interviewers 7
Copyright 2010, The World Bank Group. All Rights Reserved. Importance of the Enumerator The enumerator represents the survey and the organization to the respondent Compile information on interviewer characteristics and interview outcome rates Include lessons learned from successful interviewers in training and manuals Cover a wide range of respondent concerns during training 8
Copyright 2010, The World Bank Group. All Rights Reserved. Enumerator Characteristics Match interviewer characteristics to their respondents to reduce measurement errors Enumerator confidence can improve participation rates Experienced enumerators have higher cooperation rates 9
Copyright 2010, The World Bank Group. All Rights Reserved. Improving Contact and Cooperation Study at home patterns Respect local cultural norms Practice communication skills Post-interview checklist Callback notices 10
Copyright 2010, The World Bank Group. All Rights Reserved. Factors that Affect Participation 11 Standardization Required during questionnaire administration Discouraged during introductions Survey sponsorship Response rates differ by sponsor
Copyright 2010, The World Bank Group. All Rights Reserved. Factors that Affect Participation Survey Topics Response rates differ by survey topic, all things being equal Enumerator knowledge of survey affects cooperation rates Confidentiality –Can affect response rates 12
Copyright 2010, The World Bank Group. All Rights Reserved. Publicity and Community Liaison Strategy Advance notice of field operations Develop key messages Form local and national partnerships to deliver message to target populations Develop media, publicity, and community organization contact data base Regular information kits for contacts 13
Copyright 2010, The World Bank Group. All Rights Reserved. Hard to Reach Populations Partnerships with community groups Develop data base/ list of community groups that work with hard to reach populations by area Recruit enumerators from hard to reach populations Enumerate transient groups in a single night 14
Copyright 2010, The World Bank Group. All Rights Reserved. Implications for Survey Implementation For National Statistical Offices: Non-response measurement can improve survey methodologies Include contact, communication and cooperation in enumerator training curriculum Plan and budget for pre-testing of training instruments 15
Copyright 2010, The World Bank Group. All Rights Reserved. Implications for Survey Implementation For Field Operations Implement performance based training programs including communications Give enumerators an interview checklist Ensure quality of listing operations Ensure quality of contact and interview outcome notes 16
Copyright 2010, The World Bank Group. All Rights Reserved. Reporting Nonresponse Basic response rates should be included in all survey reports More complex nonresponse measures would be reported in special reports Always include definitions for nonresponse components Document actions to reduce nonresponse during data collection 17
Copyright 2010, The World Bank Group. All Rights Reserved. Reporting Nonresponse Analytical reports should include: Unit and item nonresponse that affect critical analysis Total unit response rate Multi-stage surveys should report for each level Longitudinal surveys for each round Nonresponse adjustment procedures Results of nonresponse bias studies and reports 18
Copyright 2010, The World Bank Group. All Rights Reserved. Reporting Nonresponse Technical reports and user guides should include: –Description of nonresponse compensation measures (weighting and/or imputation) –Evaluation of compensation procedures –All actions to increase response rate, including nonresponse follow-up –Nonresponse data by reason 19
Copyright 2010, The World Bank Group. All Rights Reserved. Section B Quiz 1.Nonresponse prevention can be carried out at what three times during data collection? 2.Statistical agencies are focusing more on efforts at which of the three times during data collection? 3.What measure should be included in all survey reports? 4.What survey staff member position is the most important in reducing nonresponse? 20