CLICK TO GO BACK TO KIOSK MENU

Slides:

Advertisements

Similar presentations

Emergency Medicine Milestones April 2, CORD Academic Assembly.

Advertisements

Modeling an EPA as a Competency Framework. EPA: Manage patients with common, single system diagnoses who require a hospital setting (Excerpt From Pediatrics.

Douglas Char, MD – Emergency Medicine Most days I feel like this! I want to be part of this! ACGME RRC.

Competency Tools to Measure Resident Progress

Purpose Program The purpose of this presentation is to clarify the process for conducting Student Learning Outcomes Assessment at the Program Level. At.

Pediatric Milestones and Evaluations A. White, MD February 7 th, 2014.

Pediatric Hospital Medicine for Medical Students Julia K. Simmons, MD.

Clinical Competency Committees What Faculty need to know Academic Affairs Committee ACEP,JMTF, CORD 1.

What is “Competency” in the New Millennium? Shirley Schlessinger, MD, FACP Associate Dean for Graduate Medical Education University of Mississippi Medical.

Milestones Jennifer Gould, MD Program Director, Diagnostic Radiology.

In 2014, U.S. Residency Programs including Ob-Gyn fully implemented the Next Accreditation System with the use of Milestone evaluation and reporting. Residency.

ACGME SIX CORE COMPETENCIES Minimum Program Requirements Language Approved by the ACGME, September 28, 1999 “The residency program must require its residents.

Jennifer Kesselheim, MD Nothing to disclose Discussion of off-label drug use: not applicable 56 th ASH Annual Meeting Disclosure Statement.

The use of OSCE to assess Patient Care, Professionalism and Interpersonal Communication Milestones in EM residents Miriam Kulkarni, MD, Harsh Sule, MD,

Assessing Specialty Specific Milestones of ‘Off-Service’ Rotators During Emergency Medicine Rotation Lauren Walter, MD, FACEP, FAAEM and Andrew Edwards,

Objectives Methods Introduction Results Conclusions To measure the self-reported competency of all EM residents with Level 1 milestones as they enter residency.

Pediatric Resident Minimum Milestone Expectations by Level of Training Su-Ting Li, MD, MPH; Daniel Tancredi, PhD; Alan Schwartz, PhD; Ann Burke, MD; Ann.

Defining Grades in the Surgery Clerkship Jeremy M. Lipman, MD MetroHealth Medical Center Case Western Reserve University School of Medicine.

Click to edit Master subtitle style Competence by Design (CBD) Foundations of Assessment.

Approaching Milestones Documentation: Tricks, Tips, and Examples Describing What We Want in a Family Physician: From Competencies to Milestones Allen F.

OBJECTIVE INTRODUCTION Emergency Medicine Milestones: Longitudinal Interrater Agreement EM milestones were developed by EM experts for the Accreditation.

Introduction References Objectives Conclusions Results Faculty provision of performance feedback is critical for residents to improve their clinical skills.

Help Us Spread the News This presentation has been developed for your use: Share and/or incorporate these slides as needed, simply source the Royal College.

Multisource Feedback in a Simulation-Based Milestone Assessment of Emergency Medicine Residents Jeffrey Siegelman MD, Sidhant Nagrani MD, Anna Gajewski.

It could be if you are a third or fourth year medical student and want to experience the specialty of anesthesia in a clinical setting ……

Entrustable Professional Activities (EPAs) for the Assessment of Early Medical Students H. Carrie Chen MD MSEd1, Margaret McNamara MD1, Arianne Teherani.

Northwestern Family Medicine Residency & Erie Family Health Center

An Alternative Certification Examination “ACE”, to assess the domains of professional practice. Morris M1*, Gillis AE2, Smoothey CO3, Hennessy M1, Conlon.

Presenter: Sarah Z. Cole, DO, FAAFP A Work in Progress (15 minutes)

Entrustable Professional Activities

University of Texas at Houston Family Medicine Residency Program

Introduction Results Objectives Conclusions Methods Limitations

Web CPI Quick reference

Development of Inter-Professional Geriatric and Palliative Care Clinic

Healthcare Matrix: Care of Patient(s) with….

Comparison of Nurse Mentor and Instructor

Angela Buffington, PhD, MA

Development of Inter-Professional Geriatric and Palliative Care Clinic

EPAs as Curriculum Tools

Clinical Assessment Dr. H

Jonathan dela Cruz, M.D., Jason A Kegg, M.D.

Angela Buffington, PhD, MA

in first year residents of different specialties.

Michael Jong, MD1, Bryan G. Kane, MD1,3, Nicole C

CLICK TO GO BACK TO KIOSK MENU

CBEI Essentials for Residents, Fellows, Advanced Practice Providers, and Faculty A 10-minute primer on student performance assessment in required clerkships.

CLICK TO GO BACK TO KIOSK MENU

Proposed End of Training EPAs

CLICK TO GO BACK TO KIOSK MENU

CLICK TO GO BACK TO KIOSK MENU Correlation Coefficient

Creation of a Milestone-Driven Simulation Based Resuscitation Course

Using an ‘Oral Board’ exam to assess for EPA 10 in

To Entrust or Not to Entrust

Reece A, Davis L, Todd P, Bellman M, Newell SJ

CLICK TO GO BACK TO KIOSK MENU

CLICK TO GO BACK TO KIOSK MENU

CLICK TO GO BACK TO KIOSK MENU

CLICK TO GO BACK TO KIOSK MENU

Gender Bias in Nursing Assessments of Emergency Medicine Residents

Christopher S. Kiefer MD, Erica B. Shaver MD,

Evaluation Rating Forms

Sociology Outcomes Assessment

Clinical Educator and Teacher Candidate Training Chapter for the Candidate Preservice Assessment for Student Teachers (CPAST) Form Developed by the VARI-EPP*

Curriculum & Instruction

General Competencies Committee September 21, 2007

Work Based Assessments

The Clinical Competency Committee

Student Learning Outcomes Assessment

Integrating Best Practices of Participant Evaluation Clinical Instructor Intensive Adrienne Small, DNP, FNP-C, CNE, CHSE Medical Instructor Duke University.

Are EM Clerkship Objectives Congruent with Milestones Expectations?

Presentation transcript:

CLICK TO GO BACK TO KIOSK MENU Do EM resident self-assessed milestone levels and that of the Clinical Competency Committee consensus align over time? Mary R Mulcare,1,2 Aleksandr M. Tichter,1,3 Bao-Thang A Nguyen,2 Sunday Clark,1,2 Kriti Gogia,2 Wallace A Carter1,2,3 1NewYork-Presbyterian Hospital Emergency Medicine Residency, New York, NY 2Division of Emergency Medicine, Weill Cornell Medicine, New York, NY 3Division of Emergency Medicine, Columbia University Medical Center, New York, NY

Background Objective Methods Self-assessment is an important skill, both in residency and beyond GME should incorporate development of this skill into biannual evaluation process Need a mechanism for feedback as the resident is learning this skill Objective To assess the agreement between the Clinical Competency Committee (CCC) assignment of milestone levels for an individual resident (gold standard) and the resident’s self-assessment of the same milestones over eight evaluation periods during four years of training. Methods One class of 12 EM residents x 4 years of training in EM Analyzed milestone levels assigned by CCC and resident on self-assessment at eight time points and in aggregate (mid-year and end of year, PGY1 through PGY4) Used weighted kappa statistics (with 95% CIs) and agreement IRB exempt

Results Participation: Residents (12): 100%, completing 79% of self-assessments required (range 67% to 92% per time point) CCC Members (9): 100% Table 1: Inter-rater Agreement of Milestones by Year of Training Residency Level Kappa (95% CI) Agreement PGY-1 Midyear (fall) 0.127 (0.044 – 0.207) 23% End-of Year (spring) 0.115 (0.049 – 0.183) 26% PGY-2 0.051 (-0.011 – 0.118) 28% -0.014 (-0.077 – 0.053) 25% PGY-3 -0.001 (-0.088 – 0.086) 30% 0.105 (0.035 – 0.183) 36% PGY-4 0.018 (-0.044 – 0.096) 44% 0.057 (-0.017 – 0.145) 52%

Results Table 2: Inter-rater Agreement of Milestone Data by Milestone Kappa 95% CI Agreement Emergency Stabilization (PC1) 0.452 (0.359 – 0.538) 21% Observation and Reassessment (PC6) 0.457 (0.368 – 0.543) 25% Airway Management (PC10) 0.433 (0.324 – 0.532) Systems-based Management (SBP2) (0.350 – 0.547) 28% Vascular Access (PC14) 0.338 (0.203 – 0.468) 29% Medical Knowledge (MK) 0.425 (0.278 – 0.544) Patient Safety (SBP1) 0.438 (0.340 – 0.537) Anesthesia/Acute Pain Management (PC11) 0.508 (0.419 – 0.602) 30% Technology (SBP3) 0.383 (0.264 – 0.483) Accountability (PROF2) 0.384 (0.288 – 0.487) 32% Multi-tasking (PC8) 0.462 (0.377 – 0.556) 33% Patient Centered Communication (ICS1) 0.392 (0.284 – 0.510) Pharmacotherapy (PC5) 0.512 (0.427 – 0.598) 34% Disposition (PC7) 0.467 (0.366 – 0.575) Goal-directed Focused Ultrasound (PC12) 0.406 (0.263 – 0.554) Professional values (PROF1) 0.38 (0.274 – 0.509) 36% General Approach to Procedures (PC9) 0.472 (0.335 – 0.590) 37% Other Diagnostic and Therapeutic Procedures: Wound Management (PC13) 0.558 (0.458 – 0.644) 38% Performance of Focused History and Physical Exam (PC2) 0.432 (0.326 – 0.559) 39% Diagnostic Studies (PC3) 0.521 (0.426 – 0.626) 41% Practice-based Performance Improvement (PBLI) 0.549 (0.443 – 0.660) 42% Team Management (ICS2) 0.525 (0.428 – 0.634) 43% Diagnosis (PC4) 0.589 (0.481– 0.682) 46%

Conclusion Overall, inter-rater reliability between CCC and resident self-assessment of milestone proficiency was low Positive trend toward improved agreement between the CCC and the resident self-assessment over the four years Additional work is needed to understand whether the low to moderate agreement is consistent with other institutions, and if it is due to the evaluation process or a lack of feedback to or coaching of the residents.