Cognitive Interview Obstacles

Slides:



Advertisements
Similar presentations
What is a Survey? A scientific social research method that involves
Advertisements

Robin L. Donaldson May 5, 2010 Prospectus Defense Florida State University College of Communication and Information.
Designing Scoring Rubrics. What is a Rubric? Guidelines by which a product is judged Guidelines by which a product is judged Explain the standards for.
Item Writing Techniques KNR 279. TYPES OF QUESTIONS Closed ended  Checking yes/no, multiple choice, etc.  Puts answers in categories  Easy to score.
COLLECTING DATA ON A SAMPLE OF RESPONDENTS Designing survey instruments.
VISION Results of the Cognitive and Field Tests 10 th Washington Group Meeting Luxembourg, 3-5 November 2010.
Measurement in Marketing Research
Disability Cognitive Test: The Philippine Experience Presented by: Carmelita N. Ericta Administrator, PNSO 6 th Annual Meeting of the Washington Group.
Designing a Questionnaire 1. planning content 2. ordering the questions 3. method of administration 4. formatting 5. testing.
Questionnaire Design.
Gathering requirements Software Engineering Project Reference:Lec. Sarah A. Alkhudair lecture Slides of SE course, KSU 1.
Designing the Questionnaire. Logical Steps to Develop a Good Questionnaire Recall the research objective, the research questions and hypotheses Identify.
Bryman: Social Research Methods, 4 th edition What is a structured interview? Useful tool of quantitative research Often used in social surveys Standardized.
Cognitive Interviewing for Question Evaluation Kristen Miller, Ph.D. National Center for Health Statistics
SPECA Regional Wrokshop on Disability Statistics, Dec 13-15, 2006 Issues Related to Disability Measurement: Cognitive testing and mode Jennifer Madans.
Sixth Meeting of the Washington Group on Disability Statistics Session 3: In-depth review of cognitive and field test results and experiences Cognition.
The Definition and Measurement of Disability: The Work of the Washington Group (continued) Daniel Mont Disability and Development Group The World Bank.
Washington Group Cognitive Test Kristen Miller Questionnaire Design Research Lab National Center for Health Statistics, USA 1) Purpose of cognitive test.
Cognition domain Cognition domain 10th Washington Group meeting Luxembourg 3-5 November 2010 Andres Montes ESCAP Statistics Division.
FATIGUE Results of ESCAP Testing Barbara M. Altman Disability Statistics Consultant Washington Group, November 3-5, 2010, Luxembourg.
September 2007 Survey Development Rita O'Sullivan Evaluation, Assessment, & Policy Connections (EvAP) School of Education, University of North Carolina-Chapel.
Understanding Observational and Interview Research Kyle Sharp A ED 615 November 6, 2006.
Chapter 12 Advanced Measurement Designs for Survey Research.
PAIN. Pain Questions Do you have frequent pain? Do you use medication for pain? If yes: In the past 3 months, how often did you have pain? Some days,
Survey Methodology Survey Instruments (1) EPID 626 Lecture 7.
Copyright 2010, The World Bank Group. All Rights Reserved. Testing and Documentation Part II.
SATMathVideos.Net A set S consists of all multiples of 4. Which of the following sets are contained within set S? A) S2 only B) S4 only C) S2 and S4 D)
Primary Research HSB 4UI ISU. Primary Research Quantitative Quantify (measure) Quantify (measure) Large number of test subjects Large number of test subjects.
Quantitative and Qualitative Methods Sebastian M. Rasinger Research Methods in Linguistics. An Introduction. Second Edition London: Bloomsbury S.M.Rasinger.
PREPARATION OF QUESTIONNAIRES PREPARATION OF QUESTIONNAIRES Chapter - 4 Dr. BALAMURUGAN MUTHURAMAN
Understanding the Washington Group Measures: Distinguishing disability status from response error.
Day 1: Well-being and Interviewing This presentation has been supported by the U.S President’s Emergency Plan for AIDS Relief (PEPFAR) through the U.S.
FORMATTING A QUESTIONNAIRE. PURPOSE OF QUESTIONNAIRE Collect measurable data from a specific group of people Success of Questionnaire= Response rate Response.
Designing Scoring Rubrics
Social Research Methods
Measurement in Marketing Research
Questionnaire Design.
New laws and Best Practices
COMPLEMENTARY TEACHING MATERIALS
Core Competencies: Choosing Study Design
WHO The World Health Survey General Introduction
Research & Writing in CJ
A CULTURAL APPROACH TO CHILD DEVELOPMENT
InteRAI Overview “Core items” assessment: Community Health Assessment (“CHA”); screening tool “items” important in all care settings (communication, self-care,
Skill Learning Principles
PSY 450 GUIDES Education for Service--psy450guides.com.
Business and Management Research
Communication Skills Lab 5
Skill Learning Principles
Assignment #3- Application: Focus on Misperception
Natalie Jackson, Managing Director of Polling
Administering Behavioral CRFs
Understanding Risk and Protective Factors: Their Use in Selecting Potential Targets and Promising Strategies for Interventions.
Exploring Naturalistic Gestures for Digital Tabletops
Asking Questions Diego Aguirre.
Coding occupations The new coding process Sue Westerman, Marc Houben.
ASSESSMENT IN COUNSELLING PREPAIRED BY: DR.MUNA ABDEEN ABDELRAHMAN.
Barbara M. Altman Disability Statistics Consultant
Business and Management Research
Interviews Although Social Surveys can be conducted using written questionnaires, sociologists often use the interview method as an alternative. The Interview.
PRINCIPLES OF WRITING AND CLASSIFICATION OF QUESTIONS
Other authors: Jenni Dyer, Margret Meehan
Contemporary Perspectives
Data Preparation (Click icon for audio) Dr. Michael R. Hyman, NMSU.
The Basics of Play Therapy for Early Childhood Intervention
Marketing Research: Course 4
CONSUMER SURVEY RESEARCH
3 Methods for Collecting Data
The Marketing Survey-29.2 After finishing this section, you will know:
Presentation transcript:

Cognitive Interview Obstacles Little or no training No understanding of cognitive methods No CAPI Multiple languages Multiple cultures Multiple levels of development

Requirements Structured interview guide Very simple instructions Few skip patterns Quantitative data and analysis

Cognitive Interview Protocol Designed to illustrate: Administration ease Interpretations Factors considered Degree of consistency with physical abilities

Cognitive Interview Protocol Demographic Section: Country, gender, age, SES Question Testing Sections Core Question Interviewer Coding Open-ended Follow-up Probe Cognitive Follow-up Probe Functioning Follow-up Probe Health Questions Subjective health Chronic condition list

Interviewer Code: Did the respondent… need you to repeat any part of the question? Yes/No have any difficulty using the response options? Yes/No ask for clarification or qualify their answer? Yes/No

Open-ended Follow-up Probe Why did you answer that way?

Cognitive Follow-up Probes: How often they had difficulty The amount of effort they needed to put into the activity How often they felt self-conscious about the difficulty The degree of concern or worry they had regarding the difficulty How often they wished they could do the do the activity better

Functioning Follow-up Probes Presence of a condition Use of an assistive device Degree of difficulty doing related activities

Health Status General health question Why did you answer that way? Health conditions

Interviewer Debriefing Details about the interview and interview setting Insight into the quality of the information

Analysis Plans Patterns in the response process Interpretation Judgment Patterns of response error Across countries and demographic variables