1. How good is good enough? RRFSS Module Validation Stephanie Totten Epidemiologist Niagara Region Public Health Department June 20, 2007

2. Working Group Members John Barbaro – Simcoe Muskoka Alyshia Landry – Waterloo Rachel Savage – Huron County Suzanne Sinclair – KFL&A Stephanie Totten – Niagara

3. Outline Background and Rationale PHAC Regional Risk Factor Contribution Proposal Current Status Next Steps

4. Why Validation? 16/23 (69.6%) RRFSS Reps and 32/41 (78.1%) Health Unit program and research staff rated the data quality of RRFSS at least 4/5 Lack of validity or reliability testing was identified as a data quality issue

5. Why Now? RRFSS Strategic Plan Short-term Goal #4: “To increase the number of validated and reliable modules” Made a priority in light of the 2007 Workshop theme PHAC Regional Risk Factor Contribution request for proposals

6. Proposal Overview Four activities for module validation identified in the Strategic Plan under the Quality Improvement and Development Strategy: –Create an inventory of what has been validated in RRFSS –Determine criteria for “reliable” and “valid” –Identify modules to be validated –Find people to do validity studies

7. ObjectiveActivitiesExpected Outcomes 1. Determination of criteria for validity and reliability in RRFSS -Review of literature for common definitions and methods of validity and reliability -Key Informant Interviews Definite criteria on how RRFSS defines valid and reliable questions 2. Development of the RRFSS inventory of module validation status -Key Informant InterviewsDetailed spreadsheet outlining validation status of RRFSS modules 3. Prioritize RRFSS modules for validation Studies -Key Informant interviews -Inventory and Strategic Plan review Detailed spreadsheet outlining top priorities for RRFSS module validation studies. 4. Develop validation study proposals for one to two modules based on priorities -Literature review and development of methods, analysis plan, ethical considerations, work plan with timelines, and draft budget One to two study proposals outlining methods for validation studies.

8. Current Status Partnership with alPHa Proposal submitted to PHAC Support from Ministry of Health Promotion

9. Next Steps Await funding decision –Form advisory group –Develop work plan Begin preliminary work on the validation inventory

10. Questions? Feedback?