1. Approaching Milestones Documentation: Tricks, Tips, and Examples Describing What We Want in a Family Physician: From Competencies to Milestones Allen F Shaughnessy, PharmD, MMedEd Tufts University Family Medicine Residency At Cambridge Health Alliance

2. Where We’re Going What is the goal of the Milestones Process? The M&Ms of Assessment: Measurable and Meaningful The Goldilocks concept of assessment methods: Not too general, not too specific Using EPAs to document milestones

3. Milestone Purpose Residents can do what we think they can do Assure the public Evaluate residency training Line up curriculum with goals Resident feedback Competence/ confidence

4. The Problems with Milestones Not progressive < ?

5. The Problems with Milestones Multiple, conflicting definitions at each level

6. The Problems with Milestones Not directly measurable Which one(s)? On paper or in practice? Once, some of the time, most of the time?

7. Drilling down into a Milestone General Competency Statement: PC-1 “Cares for acutely ill or injured patients in urgent and emergent situations and in all settings”

8. Drilling down into a Milestone

14. Fitting the pieces Milestone Specific levels Measurable behavior Embodied competencies Assessment Unsupervised practice

15. PC-1 Cares for acutely ill or injured patients in urgent and emergent situations and in all settings Inside pics Level 1. Gathers essential information about the patient (history, exam, diagnostic testing, psychosocial context)

16. PC-1 Cares for acutely ill or injured patients in urgent and emergent situations and in all settings Inside pics Level 2. Consistently recognizes common situations that require urgent or emergent medical care.

17. PC-1 Cares for acutely ill or injured patients in urgent and emergent situations and in all settings Level 3. Consistently recognizes complex situations requiring urgent or emergent medical care.

18. PC-1 Cares for acutely ill or injured patients in urgent and emergent situations and in all settings Level 4. Coordinates care of acutely ill patient with consultants and community services.

19. PC-1 Cares for acutely ill or injured patients in urgent and emergent situations and in all settings Not all houses are the same!

20. Levels of Assessment Global Assessment (faculty review) “Pretty good physician” Geographic assessment (Precepting) “Good outpatient work” Professional Activity “Manages her patients with hypertension well” Competency Knows the definitions of the stages of hypertension Task Analysis Selects an appropriate cuff for blood pressure measurement

22. ` Competency The ability to do something successfully; a quality or state of being Entrustable Professional Activity A professional activity; the “unit of work” that can be entrusted to competent doctor Milestones “Developmentally-based family medicine-specific attributes that family medicine residents can be expected to demonstrate as they progress through their programs.”

23. Miller’s Pyramid In action, over time OSCE, brief observation Testing Case discussion

26. Anatomy of an EPA Be able to demonstrate how to evaluate a patient with urinary symptoms (history, physical, laboratory tests to order) Be able to explain how to differentiate between uncomplicated and complicated urinary tract infection and pyelonephritis Be able to develop an appropriate treatment plan for patients with uncomplicated and complicated UTI and pyelonephritis, including hospitalization and phone treatment. Areas of competence + + Taking care of a patient with acute urinary symptoms Entrustable Professional Activity

27. From EPA to Milestones Taking care of a patient with acute urinary symptoms Entrustable Professional Activity PC1: Level 2 MK2: Level 1

28. EPAs link to Milestones The patient with acute urinary symptoms The woman with abnormal vaginal bleeding The patient with vomiting and/or nausea EPAs + + PC-1 Cares for acutely ill or injured patients in urgent and emergent situations and in all settings Milestone The patient with a cough + The patient with acute pain + + +

30. How to Measure Performance? Observation Behaviors Skills Communication Written reflection Attitudes Cognition Case discussions, chart review (“can do”) Precepting (“does”)

32. Points collected..

33. Start to reveal...

34. The full picture of a learner

36. Drilling down into a Milestone Global Assessment

37. Competency Assessment