1. Program Evaluation in the Queen’s PGME Transition Designing Competency At Queen’s Workshop February 23-25 2015 Denise Stockley, PhD Provost’s Office (Teaching and Learning Portfolio) and Faculty of Health Sciences Elaine Van Melle PhD, Education Scientist, RCPSC

2. Outline 1.Program Evaluation Overview 2.3 year plan 3.Getting started...

3. Program Evaluation Team Internal Queen’s University Program Evaluation LeadDenise Stockley External Royal College Program Evaluator Consultant Elaine Van Melle Internal Faculty of Health Science Academic LeadDamon Dagnone

4. CBME Program Evaluation is Guided By: 1.How do we prepare programs for the adoption of CBME? 2.Are we implementing CBME as intended? 3.What strategies are required to sustain the adoption of CBME across the institution? 4.How has (or is) CBME contributing to changes in behaviours (e.g., relationships, actions, activities, policies or practices) across all levels of the institution?

5. Conceptual Framework - Concerns-Based Adoption Model

6. Three Year Project Year 1 - Building the Foundation Year 2 - Implementing the Change Year 3 - Ensuring Sustainability

7. Program Evaluation Year 1 Building the Foundation Collection of baseline data Distribute the Stages of Concern Questionnaire Create an Innovation Configuration Map

8. Innovation Configuration Map Specific descriptions of what CBME looks like in practice Program Leadership Faculty (as teachers, as assessors) Residents On a continuum... Ideal Transitioning Preparing Business as Usual

9. Core Components of CBME – First Step What does this figure tell you about CBME? How would you (or would you?) use it?

10. Core Components of CBME – First Step What does this figure tell you about CBME? How would you (or would you?) use it? CBME... Has a strong theoretical foundation Is made up of many components Components need to work together

11. For More Information: For more information or to engage in the process, contact: Denise Stockley – stockley@queensu.castockley@queensu.ca