Evaluation and Promotions: Introduction for PGY1s Thomas Maniatis, MD, CM, MSc (Bioethics), FACP, FRCPC Chair, Faculty Postgraduate Promotions Committee July 30, 2014

Conflict of interest None to declare

CanMEDS framework Medical Expert: knowledge, skills, judgment Communicator: patients, colleagues Collaborator: team-work Manager: computer skills, time management, leadership Health Advocate: standing up for patients Scholar: reading around cases, bringing the evidence to the bedside, teaching

CanMEDS framework Professional: ethics, integrity, honesty may be addressed both in rotations and outside of rotations

Principles of evaluation Feedback: communication to another person which gives information about how he/she affects and is perceived by others… Evaluation: rating an individual’s performance based on predetermined expectations

The Role of Feedback in Evaluation A B Formative Feedback Summative Evaluation

Formative vs. Summative Formative feedback: done with the intent of providing ongoing information for individual modification Summative evaluation: done at the end of a course or program to determine whether the individual has met a set of predetermined expectations

Good feedback is… Based on a common understanding of expectations goals and objectives, level-specific Based on observations and not inferences Specific Descriptive

Good feedback is… Timely Constructive

Bad feedback is… Based on a subjective set of expectations Based on inferences and assumptions Very general or vague “you’re doing fine…” “keep reading…” Delayed Destructive

Resident’s role in feedback Ask for it if not volunteered every 2 weeks or at change of shifts chance to improve Think about how you did ahead of time see if your perceptions are aligned with how others see you Ask for specific things to work on to improve Listen!

Resident’s role in feedback If you’re not sure you agree, ask for specific examples to better understand Think about it afterwards reflection is the most important part of integrating feedback avoid quickly brushing off feedback recognize the difference between “personality” and “behaviours” the first is relatively fixed and the other is changeable

Resident’s role in evaluation Look in one45 regularly Must evaluate rotation and teachers before looking at own evaluations Professional responsibility to look at and think about evaluations received logs in one45 acknowledge seeing them by “clicking” on the button

Resident’s role in evaluation Recognize the importance of multiple independent observations should be taken seriously

Evaluations and Promotions McGill has a set of rules guiding evaluation and promotion of residents Doing OK overall Satisfactory…meets or sometimes exceeds…average or above average…80% of residents/rotations/grades Superior…consistently exceeds…excellent…10% residents/rotations/grades

Evaluations and Promotions Weaknesses identified Borderline…some weaknesses identified Unsatisfactory…falls short of expectations

Evaluations and Promotions It’s usually okay to have some borderline elements in the occasional evaluation Overall borderline or unsatisfactory equivalent to “failed” rotation specific requirements as per Promotions Rules meet with Program Director to discuss

Who sees your evaluations? First and foremost, you! Program Director delegate (Site Director, Evaluation Director) Program Admin. PGME

Who sees your evaluations? Formal meeting with PD q6month to review evals and overall progress PD and you are the only people who have a bigger perspective on your progress generally speaking, no forward feeding at McGill

Program Promotions Committee (PPC) Monitors progress of residents in program Promotes residents each year to next level, if appropriate Identifies residents in academic difficulty and monitors progress Applies McGill’s Promotions rules if remediation or other actions are needed

Faculty Postgraduate Promotions Committee (FPPC) Monitors and ratifies decisions of PPC Ensures McGill’s Promotions rules are applied fairly Monitors residents in academic difficulty

What if I don’t agree? First, discuss it with your Program Director and/or rotation supervisor Appeals are an option… please see “Evaluation and Promotions in Postgraduate Training Programs” (updated for July 1, 2014 academic year)

McGill’s “75% rule” McGill Promotions rule states that a residents must complete at least 75% of a given rotation for it to be considered complete Otherwise, the evaluator may enter it as “incomplete” “repeat” rotation needed Be careful with time off and potential tensions with this rule!

Summary CanMEDS is the basic framework guiding all evaluations during your residency Feedback and evaluation are part of the day-to-day fabric of being a resident McGill’s has a well structured process for evaluations and promotions