Aiding Respondent Recall Researchers should be made aware of the realities of memory and the many factors affecting it. In addition, researchers should.

Slides:



Advertisements
Similar presentations
Self-Administered Surveys: Mail Survey Methods ChihChien Chen Lauren Teffeau Week 10.
Advertisements

Survey Design. So Many Surveys Political ‘push polls’ – Trying to influence, not collect data Marketing polls – Some are just advertisements News Polls.
Structured Survey Interviewing: Telephone and In-Person Surveys Behice Ece Ilhan Chihchien Chen.
Eye-witness testimony
Items of memory are like physical objects. The IMAGE is of a Storehouse… Consists of Items – facts, lists, the enumerated points of a speech, etc.
Questionnaire Design Sudman & Bradburn (1988).  Question wording is a crucial element in maximizing the validity of survey data obtained by a questionnaire.
Sentence Memory: A Constructive Versus Interpretive Approach Bransford, J.D., Barclay, J.R., & Franks, J.J.
Organizational Behaviour
Social Research Methods: Qualitative and Quantitative Approaches, 5e.
Dr. Michael R. Hyman, NMSU Survey Error: Focus on Systematic Error.
Measurement Validity and Reliability. Reliability: The degree to which measures are free from random error and therefore yield consistent results.
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 8 Using Survey Research.
Focus on Systematic Error
Agenda for January 25 th Administrative Items/Announcements Attendance Handouts: course enrollment, RPP instructions Course packs available for sale in.
Questionnaire Issues -- Asking the Right Questions.
Communication Ms. Morris.
3 Methods for Collecting Data Mgt Three Major Techniques for Collecting Data: 1. Questionnaires 2. Interviews 3. Observation.
1 MTN-003 Training General Interviewing Techniques Some specific tips for administering the Screening interviewer-administered CRFs SSP Section 14.
Classroom Assessment A Practical Guide for Educators by Craig A. Mertler Chapter 5 Informal Assessments.
Choosing Your Primary Research Method What do you need to find out that your literature did not provide?
CHAPTER FIVE (Part II) Sampling and Survey Research.
Section 1.1, Slide 1 Copyright © 2014, 2010, 2007 Pearson Education, Inc. Section 14.1, Slide 1 14 Descriptive Statistics What a Data Set Tells Us.
Providing Stellar Service Sally Schmall, MSW, SPHR Organizational Development Manager.
Stat-472 Survey design Questionnaire Design Issues Nonresponse, Refusals and Response Rate.
Introduction Theoretical Perspectives Research.  Sampling : Identifying the appropriate population of people to be studied.  Random Sample : Each member.
SURVEY DESIGN WORDING ISSUES QUESTIONNAIRE DESIGN ISSUES STAT 472.
Creating Surveys. Getting the right info KISS Your questionnaire should be as short as possible. Make a mental distinction between what is essential to.
MARKETING RESEARCH CHAPTERS
Thinking. So what is ‘thinking’? In a general sense, thinking is the intentional use of cognitive capabilities for some purpose. –Recall some kind of.
© 2013 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
 Open ended questions: no options provided. ◦ Pros:  access ideas the researcher has not considered  insight into respondents’ vocabulary  insight.
 Memory doesn't work the same in every situation.  Certain factors, such as time of day, location, distractions, events and internal states can affect.
2007 Youth Risk Behavior Survey Results Alaska High School Survey Grades 9-12 Alaska Division of Public Health Weighted Data Physical Activity.
Critical Incident Stress
Sources of bias in research Your bait of falsehood takes this carp of truth; And thus do we of wisdom and of reach, With windlasses and with assays of.
By Jamal Panhwar1 PERCEPTION 1. By Jamal Panhwar2 2 When you change the way you look at things, the things you look at change.
Question Wording Pierre-Auguste Renoir: The Ball at the Moulin de la Galette (1876)
Developing Survey Items Bonnie L. Halpern-Felsher, Ph.D. Professor University of California, San Francisco.
Copyright 2010, The World Bank Group. All Rights Reserved. Questionnaire Design Part II Disclaimer: The questions shown in this section are not necessarily.
The Challenge of Non- Response in Surveys. The Overall Response Rate The number of complete interviews divided by the number of eligible units in the.
FIELD SURVEY SCRUTINY MANUAL. THE QUESTIONNAIRE  DEMOGRAPHICS  DRINKING WATER SUPPLY  SANITATION SERVICES  HEALTH SERVICES  BASIC EDUCATION.
Dr. Fowler AFM Unit 8-1 Organizing & Visualizing Data Organize data in a frequency table. Visualizing data in a bar chart, and stem and leaf display.
AP STATISTICS Section 5.1 Designing Samples. Objective: To be able to identify and use different sampling techniques. Observational Study: individuals.
MARKETING RESEARCH CHAPTERS 7: Descriptive Research Design: Survey and Observation 8 Experimentation.
Copyright 2010, The World Bank Group. All Rights Reserved. Testing and Documentation Part II.
Listening & Responding to Others
Chapter X Questionnaire and Form Design. Chapter Outline Chapter Outline 1) Overview 2) Questionnaire & Observation Forms i. Questionnaire Definition.
Administration Code for Kentucky’s Educational Assessment Program Spring 2012.
Dyslexia Thursday 21 st November 2013 Laura Bradbury and Donna Lloyd.
I’m Stronger Than a Text A Workshop on Reading Comprehension Skills Worksheet.
Models in Science.
For Example…...The impact of different example types on frequency estimates Presented at the 2008 AAPOR annual conference in New Orleans, LA.
Consider the following experiment, similar to one that was conducted by Smith, Lingle, and Brock (1978). Each participant interacted for an hour with another.
Section 1.1, Slide 1 Copyright © 2014, 2010, 2007 Pearson Education, Inc. Section 14.1, Slide 1 14 Descriptive Statistics What a Data Set Tells Us.
Organizing and Visualizing Data © 2010 Pearson Education, Inc. All rights reserved.Section 15.1, Slide
Questionnaires and Survey Design. Target population Sampling frame Not included in sampling frame Not eligible for survey Cannot be contacted Refuse to.
Questionnaire & Form Design
Designing Questionnaires Chapter 15. Selecting Question Type Open ended questions: no response options provided. Open ended questions: no response options.
ANXIETY AND AGE.  There is a difference in results found in lab experiments and in real life.  Recall after real life events is generally better. 
10 Classic Evaluation Questions to use at your meetings
PSYCHOPATHOLOGY OF CHILDREN AND FAMILY
Measurement Reliability and Validity
Module 2: Demand Forecasting 2.
Section 7.4 Cautions about Sampling
Memory in Everyday Life
Question Bias and memory effect
PRINCIPLES OF WRITING AND CLASSIFICATION OF QUESTIONS
Communication Skills Interviewing and assessment By Dr. Vian Ahmed
10 Classic Evaluation Questions to use at your meetings
Presentation transcript:

Aiding Respondent Recall Researchers should be made aware of the realities of memory and the many factors affecting it. In addition, researchers should also take into consideration that a non-response might be the result of some other factor besides poor memory or forgetfulness. In most cases, when a question goes unanswered, the researcher does not know if it is the result of poor memory recall, poor questionnaire design, confusion, or simply a decision by the respondent to skip the question due to the sensitive nature of the question.

Aiding Respondent Recall Significant issue for survey questions: the respondent’s ability to accurately recall past behavior and events Recalling events takes more time and effort The ability to recall accurately declines over time Most respondents can recall significant events that occurred in the past several week, for hospitalization and crime victimization studies, also, half are inaccurate a year later

Memory is less trustworthy than social scientists once assumed. It is affected by many factors: The topic (threatening or social desirable) Events occurring simultaneously and subsequently The significance of an event for a person Situational conditions (question wording and interview style) The respondent's need to have internal consistency.

Need to customize questions and interpret results cautiously Provide respondents with special instructions and extra thinking time

The complexity of respondent recall does not mean that survey researchers can not ask about past events rather, they need to customize questions and interpret results cautiously Researchers should provide respondents with (1) Special instructions and extra thinking time (2) Provide aids to respondent recall (fixed time frame, location references) Question: How often did you attend a sporting event last winter? Better question: I want to know how many sporting events you attended last winter. Let's go month by month. Think back to December. Did you attend any sporting events for which you paid admission in December? Now, think back to January. Did you attend any sporting events in January?

Mooney and Gramling (1991) asked students twom types of questions about drinking behavior Standard questions: On the average, how many days a month have you had something to drink? On the average, how many drinks do you have each of these times? Yielded much lower results than asking the same question about 12 locations (e.g., bar, relative’s home … etc) and summing the total

Many respondents will telescope compress time when asked about the frequency and over- report recent events Telescoping Two techniques to reduce telescoping (i) Situational Framing Ask a respondent to recall a specific situation and ask them about it (ii) Decomposition Ask several specifics and then add them up- such as how much one drank in a week then total for drinking in a year