1. Improving Screening Procedures for Rare Populations in ABS Surveys

2. Quality in Official Statistics Q2010 Helsinki 4-6 May 2010 Introduction ABS Staff –Author: Steve Cohen (stephen.cohen@abs.gov.au) –Presenter: Kettie Hewett (kettie.hewett@abs.gov.au) Purpose Consequences Problems encountered

3. Quality in Official Statistics Q2010 Helsinki 4-6 May 2010 Pensioners On the doorstep: “Does anyone from this household currently receive any income from an Australian Government pension, benefit or allowance?” Followed by: “Is an Australian Government pension, benefit or allowance the main source of income for this household?” And: “Is this main source of income an Age Pension or Department of Veterans’ Affairs Service Pension?” Monitor response vs. expected rates throughout enumeration Respect social norms and ask sensitive questions only after building rapport Avoid leading questions when writing sequencing questions

4. Quality in Official Statistics Q2010 Helsinki 4-6 May 2010 Diplomats “Are you currently in Australia on a diplomatic visa?” Consider the ‘flow’ of the survey when placing questions

5. Quality in Official Statistics Q2010 Helsinki 4-6 May 2010 Victims of Sexual assault “The final Crime and Safety questions are about sexual assault and whether the police were told about the incident. I will not be asking for any further details about this. “Since [month] last year, have you been a victim of sexual assault or a victim of attempted sexual assault?” If yes, followed by; “Did anyone tell the police about the most recent incident?” Ensure interviewers are ‘onside’ and comfortable with the purpose, wording and context of the question Pre-empt and try to counteract reasons for soft refusal.

6. Quality in Official Statistics Q2010 Helsinki 4-6 May 2010 Aboriginal people “Is the person of Aboriginal or Torres Strait Islander Origin?” (Census) “Are you of Aboriginal or Torres Strait Islander origin?” (CAPIs) Rare populations may benefit from customised procedures. Maintain good institutional environment and build trust in the organisation. Avoid scoping/sequencing based on single unreliable questions.

7. Quality in Official Statistics Q2010 Helsinki 4-6 May 2010 Defence Force Personnel “Are you a member of a permanent defence force?” Be aware some respondents want to be in the interview. Ensure interviewers understand the purpose of. the scoping question so they can clarify ambiguous responses. Use further follow-up questions to ensure true positives/true negatives

8. Quality in Official Statistics Q2010 Helsinki 4-6 May 2010 Physically Active “The next few questions are about are about physical activity. First I’ll ask about vigorous physical activity. Then I’ll ask about any more moderate activities. “Did you do any vigorous physical activity…?” [If yes: Further questions about vigorous PA] “Did you do any moderate physical activity…?” [If yes: Further questions about moderate PA] Use ‘orienting’ statements to help respondents decide where to report. Consider using further follow-up questions to verify that they should be in the sequence: don’t assume correct sequencing!

9. Quality in Official Statistics Q2010 Helsinki 4-6 May 2010 Learning and Motivation First, for respondents: “Are you employed?” [If yes: Follow up with further questions] Then for the proxies: “Is employed?” [If yes: Follow up with further questions] Beware of learning both within and between respondents! –Avoid repetitious loops –Consider asking sequencing questions at start, and following up after all have been asked

10. Quality in Official Statistics Q2010 Helsinki 4-6 May 2010 Conclusions? Must avoid unreliable filter questions. Good question design helps. Avoid relying on a single question before acting. –Especially if consequences are large Test whenever possible.