Evaluating Filter Questions Used for the Participation & Activity Limitation Survey David Lawrence Questionnaire Design Resource Centre Statistics Canada QUEST 2007

Overview  PALS background  Rationale for study  Population of interest  Findings & Observations  What now

PALS Background  National post-censal survey  Target: Canadian adults & children whose everyday activities may be limited due to a health-related condition or problem  Conducted 4 times: 1986, 1991, 2001 & 2006  Census filter questions used to create a sampling frame.

Rationale for Study  On-going initiative to improve efficiencies in the collection of social statistical data  Review of many social concepts towards harmonizing various questions included on social surveys.  Activity limitation questions are a part of this review.  Evaluate the performance of the filter questions

Population of Interest Two specific areas of interest:  ‘False positive’ respondents  Respondents having ‘soft’ conditions.

Methodology  57 cognitive interviews with PALS respondents  Interviews conducted at focus group facilities  Four test sites  Participants:- False positive adults - False positive children - Adult respondents having a ‘soft’ condition - Child respondents having a ‘soft’ condition

Specific Objectives Explore:  comprehension of filter questions -question intent -meaning of terms  reporting issues related to “soft” conditions  potential structural problems with questions

Census Filter Question Do you have any difficulty hearing, seeing, communicating, walking, climbing stairs, bending, learning or doing any similar activities? ОYes, sometimes ОYes, often ОNo

Canadian Community Health Survey The next few questions deal with any current limitations in your daily activities caused by a long-term health condition or problem. In these questions a long-term condition refers to a condition that is expected to last or has already lasted 6 months or more. Do you have any difficulty hearing, seeing, communicating, walking, climbing stairs, bending, learning or doing any similar activities? ОYes, sometimes ОYes, often ОNo

Activity Reduction Questions Does a physical condition or mental condition or health problem reduce the amount or kind of activity you can do:...at home? …at work or school? … in other activities for example, transportation or leisure? Yes, sometimes Yes, often No

Findings & Observations  Question context  Question location  Terminology  Mode  Proxy vs. non-proxy response

What Now?  ‘No’ sample (False negatives) … May 2007  Further evaluation … quantitative study?  Address issues pertaining to harmonization …