We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byRonaldo Calland
Modified about 1 year ago
Accreditation Council for Graduate Medical Education The Next Accreditation System: A Resident Perspective © 2013 Accreditation Council for Graduate Medical Education (ACGME) ACGME Council of Review Committee Residents
“We improve health care by assessing and advancing the quality of resident physician education through accreditation.” © 2013 Accreditation Council for Graduate Medical Education (ACGME) ACGME Mission Statement
Purpose Provide a brief history of the accreditation process Describe the components of the Next Accreditation System, including the Milestones and the Clinical Learning Environment Review program Address resident/fellow questions and concerns © 2013 Accreditation Council for Graduate Medical Education (ACGME)
Glossary of Terms ACGME – Accreditation Council for Graduate Medical Education RC – Review Committee NAS – Next Accreditation System CLER – Clinical Learning Environment Review program CCC – Clinical Competency Committee Institution © 2013 Accreditation Council for Graduate Medical Education (ACGME)
A Brief History 1999 – The ACGME and American Board of Medical Specialties (ABMS) establish the six Core Competencies Designed to shift emphasis from process-oriented to outcomes- oriented standards in physician education ACGME required residency/fellowship programs to use them as a rubric (a.k.a., the “Outcome Project”) 2002 – Public and political pressure on the GME community to produce physicians capable of cost- conscious, patient-centered care begins to increase 2009 – The ACGME, ABMS boards, specialty colleges/academies, residency/fellowship program directors, and residents/fellows begin to define the “Milestones” © 2013 Accreditation Council for Graduate Medical Education (ACGME)
A Brief History 2012 – Alpha test sites begin to implement Milestones at the individual program level 2013 – NAS Phase I programs implement Milestones 2014 – The NAS is in place across all specialties; all programs must implement Milestones © 2013 Accreditation Council for Graduate Medical Education (ACGME)
The Six Core Competencies © 2013 Accreditation Council for Graduate Medical Education (ACGME) Patient CareMedical Knowledge Practice-based Learning and Improvement Interpersonal and Communication Skills ProfessionalismSystems-based Practice
Why Is a New System Needed? The old process-based system was “one size fits all” We need to standardize outcomes while simultaneously allowing programs to individualize education Good programs must be free to innovate We need to shift from a “catch them being bad” to a “reward them for being good” accreditation paradigm © 2013 Accreditation Council for Graduate Medical Education (ACGME)
The Next Accreditation System © 2013 Accreditation Council for Graduate Medical Education (ACGME)
The NAS in a Nutshell A continuous accreditation model based on key screening parameters – this list is not all encompassing and is subject to change Annual program data (resident/faculty information, major program changes, citation responses, program characteristics, scholarly activity, curriculum) Aggregate board pass rate Resident clinical experience Resident Survey and Faculty Survey (latter is new) Semi-annual resident Milestone evaluations 10-year Self-Study and Self-Study Site Visit CLER Site Visits © 2013 Accreditation Council for Graduate Medical Education (ACGME)
10-Year Self-Study Visits © 2013 Accreditation Council for Graduate Medical Education (ACGME) Current Accreditation SystemNext Accreditation System Site visits every 5 years (or less)Scheduled site visits every 10 years Programs evaluated by Review Committee in conjunction with site visits Program data evaluated annually by the Review Committee Large printed Program Information Form (PIF) No PIF; data transmitted electronically to ACGME annually Periodic evaluationLongitudinal evaluation Process-oriented (provide appropriate documentation) Performance-oriented (evaluate performance against goals) Future goals not addressed Helps programs establish goals for the future
The Review Committee in the NAS Use key annual data parameters to identify concerning trends or areas of concern Concentrate efforts on struggling programs – motivate them to improve and monitor progress in real-time Empower strong programs to innovate Conduct a complete review of each program, using a team-based, department-wide evaluation of programs every 10 years Issue at least one accreditation decision per program annually © 2013 Accreditation Council for Graduate Medical Education (ACGME)
Accreditation Categories Initial Accreditation (new programs) Initial Accreditation with Warning Continued Accreditation Continued Accreditation with Warning Probationary Accreditation Withhold/Withdrawal of Accreditation © 2013 Accreditation Council for Graduate Medical Education (ACGME)
Clinical Learning Environment Review (CLER) Site Visits © 2013 Accreditation Council for Graduate Medical Education (ACGME)
An Institutional Assessment All programs within an institution evaluated simultaneously CLER is NOT tied to program or institutional accreditation Six areas of focus: Resident/fellow engagement/participation in patient safety programs Resident/fellow engagement/participation in QI programs Establishment and oversight of institutional supervision policies Effectiveness of institutional oversight of transitions of care Effectiveness of duty hours and fatigue mitigation policies Activities addressing the professionalism of the educational environment Formative, non-punitive learning process for institutions and the ACGME © 2013 Accreditation Council for Graduate Medical Education (ACGME)
CLER Feedback Site visitors conduct “walk arounds” accompanied by resident/fellow hosts/escorts designed to facilitate contact with nursing and support staff and patients (eventually) Meetings held with: DIO, GMEC Chair, CEO, CMO, CNO CPS/CQO Core faculty Program directors Residents/Fellows Answer questions honestly if approached by CLER site visitors No “gotchas,” and no stealth accreditation impact © 2013 Accreditation Council for Graduate Medical Education (ACGME)
Milestones © 2013 Accreditation Council for Graduate Medical Education (ACGME)
Observable developmental steps from Novice to Expert/Master (based on Dreyfus model) Organized under the six domains of clinical competency Set aspirational goals of excellence (Level 5) Provide a blueprint for resident/fellow development across the continuum of medical education Working and Advisory Groups were anchored by members of each specialty, including board members, program directors, Review Committee members, national specialty organization leadership, and residents/fellows - with ACGME support General competencies were translated into specialty-specific competencies © 2013 Accreditation Council for Graduate Medical Education (ACGME) Premedical Education BA/BS Medical Education MD Specialty Education (Residency) Subspecialty Education (Fellowship) Continuing Education/ (MOL – MOC) Milestones
PC1. History (Appropriate for age and impairment) Level 1Level 2Level 3Level 4Level 5 Acquires a general medical history Acquires a basic physiatric history including medical, functional, and psychosocial elements Acquires a comprehensive physiatric history integrating medical, functional, and psychosocial elements Seeks and obtains data from secondary sources when needed Efficiently acquires and presents a relevant history in a prioritized and hypothesis driven fashion across a wide spectrum of ages and impairments Elicits subtleties and information that may not be readily volunteered by the patient Gathers and synthesizes information in a highly efficient manner Rapidly focuses on presenting problem, and elicits key information in a prioritized fashion Models the gathering of subtle and difficult information from the patient General Competency Developmental Progression or Set of Milestones Sub-competency Specific Milestone © 2013 Accreditation Council for Graduate Medical Education (ACGME)
Milestone Assessment Milestones are a summary of how a resident/fellow is progressing In some specialties, they mark progress towards Entrustable Professional Activities (EPAs) Real life patient care episodes comprising the majority of the Milestones; achievement of the most sophisticated EPAs defines proficiency There are no hard and fast rules for how residents/fellows can or should progress through the Milestones The program CCC evaluates the progress of each resident/fellow © 2013 Accreditation Council for Graduate Medical Education (ACGME)
Based on Holistic Evaluation © 2013 Accreditation Council for Graduate Medical Education (ACGME) Clinical Competency Committee End-of- Rotation Evaluations Peer Evaluations Self Evaluations Case Logs Student Evaluations Patient/ Family Evaluations Operative Performance Rating Scales Nursing and Ancillary Personnel Evaluations Assessment of Milestones Clinic Workplace Evaluations Mock Orals OSCE ITE Sim Lab
© 2013 Accreditation Council for Graduate Medical Education Information Current as of December 2, 2013 Competency Development Model Dreyfus SE and Dreyfus HL. 1980 Carraccio CL et al. Acad Med 2008;83:761-7 Time, Practice, Experience Novice Advanced Beginner Competent Proficient Expert/ Master MS3 MS4 PGY-1 PGY-3 MILESTONES Curriculum
What is a Clinical Competency Committee? A modified promotions committee Composed of at least three faculty members (can include non-physicians) Evaluates residents/fellows on the Milestones and provides feedback to residents AT LEAST semi-annually Allows for more uniform evaluation of residents/fellows (less individual bias) Recommends either promotion, remediation, or dismissal for each resident/fellow Programs will submit CCC assessments to the ACGME as part of the annual review process © 2013 Accreditation Council for Graduate Medical Education (ACGME)
© 2013 Accreditation Council for Graduate Medical Education Information Current as of December 2, 2013 The NAS Milestone Assessment System Assessments within Program (examples): Direct observations Audit and performance data Multi-source FB Simulation ITExam Judgment and Synthesis: CCC Residents/Fellows Faculty, PDs and others Milestones and EPAs as Guiding Framework and Blueprint ACGME Review Committees Unit of Analysis: Program Institution and Program Milestone Reporting
Program Assessment Formal Program Evaluation Committee established Should be equivalent to the annual review programs are already required to perform Programs are required to show that they are responding to areas of concern identified in the program review and that interventions are having the desired effect © 2013 Accreditation Council for Graduate Medical Education (ACGME)
Milestone Benefits © 2013 Accreditation Council for Graduate Medical Education (ACGME) Program BenefitsResident/Fellow Benefits Provide tools needed to define and assess outcomes Potentially permit true graduated responsibility (proof positive that you are proficient to practice unsupervised) Highlight curriculum inadequacies Provides concrete metrics for evaluation Guide curriculum development No more “nice guy, showed up on time” feedback allowed Allow early identification of under- (and over-) performers Sets concrete expectations for resident progression
Can Milestones Hurt Me? They are not graduation requirements They are not “one size fits all” They are not a means of holding you in residency/fellowship because you are not at Level 4 in all areas The determination of competency to practice and board eligibility remains the purview of your program director They are not a means of graduating early because you achieve Level 4 in all areas – each specialty board will have to grapple with this issue as programs gain experience with using them © 2013 Accreditation Council for Graduate Medical Education (ACGME)
In Summary A focus on outcomes benefits everyone (patients, programs, and residents/fellows) The NAS should permit innovation while ensuring that graduating residents/fellows can provide effective, independent patient care The CLER program adds an institutional dimension that focuses on establishing a humanistic educational environment – it is not an additional accreditation wicket Many names are changing, but they have foundations in the current accreditation system © 2013 Accreditation Council for Graduate Medical Education (ACGME)
In Summary The Milestones are not perfect - they will require revision as programs gain experience using them The Milestones are not absolute benchmarks that determine if and when you graduate The Milestones should lead to better understanding of what is expected of you (and when it is expected) and improve the feedback you receive This is a good thing! © 2013 Accreditation Council for Graduate Medical Education (ACGME)
Suggested References 1. A Goroll, C Sirio, FD Duffy, RF LeBlond, P Alguire, TA Blackwell, WE Rodak, and TJ Nasca, for the Residency Review Committee for Internal Medicine. A New Model for Accreditation of Residency Programs in Internal Medicine. Ann Intern Med. 2004;140:902-909. 2. TJ Nasca, I Philibert, TP Brigham, TC Flynn. The Next GME Accreditation System: Rationale and Benefits. NEJM. 2012; 366(11):1051-1056. 3. TJ Nasca, SH Day, ES Amis, for the ACGME Duty Hour Task Force. Sounding Board: The New Recommendations on Duty Hours from the ACGME Task Force. NEJM. 2010; 362(25): e3(1-6). 4. TJ Nasca, KB Weiss, JP Bagian, and TP Brigham. The Accreditation System After the “Next Accreditation System”. Academic Medicine. 2014; 89(1):1-3. 30 © 2013 Accreditation Council for Graduate Medical Education (ACGME)
Information current as of December 2, 2013 ©2013 Accreditation Council for Graduate Medical Education (ACGME) Milestones.
Accreditation Council for Graduate Medical Education © 2014 Accreditation Council for Graduate Medical Education Competency-based Medical Education (CBME)
Accreditation Council for Graduate Medical Education Milestones are Coming: A Conversation with the Family Medicine Milestones Committee May 2013.
McGaw’s Overview of the Next Accreditation System (NAS)
Next Accreditation System (NAS) Primer Cuc Mai IM Residency Program Director Annual PD Workshop 2015.
Annual Data Collected and Reviewed 1. Annual ADS Update - Streamlined ◦ Program Attrition ◦ Program Characteristics – Structure and Resources ◦ Scholarly.
Assigning Milestone Evaluations in Internal Medicine Melvin Blanchard, MD, FACP Program Director, Internal Medicine Chief, Division of Medical Education.
Accreditation Council for Graduate Medical Education Milestone Project Update Emergency Medical Services January 17, 2014 Jane Brice MD, MPH Professor.
GRADUATE MEDICAL EDUCATION Preliminary Feedback from ACGME CLER Site Visit August 19-21, Program Director Retreat Alan J. Smith, PhD, MEd Assistant.
ACGME Next Accreditation System AAMC Contacts: Carol Aschenbrener, M.D., Sunny Yoder
PRESENTED BY: Michael T. Flannery, M.D., F.A.C.P. Professor of Medicine GME Internal Review Director.
Making CLER “clear” Preparing for the Clinical Learning Environment Review.
Next Accreditation System Safe Care for Current and Future Patients.
What is the difference between milestones and evaluations? Why do so many struggle with this?
MILESTONES, EPAS, NAS…AND OTHER ACGME JARGON Committee on Graduate Medical Education September 24, 2012 Sara LP Ross, MD.
©2013 Accreditation Council for Graduate Medical Education (ACGME) Information current as of December 2, 2013 Recent Changes in ACGME Policy.
The Challenge and Importance of Evaluating Residents and Fellows Debra Weinstein, M.D. PHS GME Coordinators Retreat March 25, 2011.
Competency Tools to Measure Resident Progress Carol Vandenakker-Albanese, MD Residency Program Director Department of PM&R UC Davis Health System November.
Program Evaluation Committees (PEC), Annual Evaluations, and the 10 year Self Study and Visit in the Next Accreditation System Cuc Mai MD FACP August 2014.
STACEY T. GRAY, MD PROGRAM DIRECTOR, HARVARD MEDICAL SCHOOL.
By Lynne Meyer, PhD, MPH August What is CLER? CLER Site Visits are required by the ACGME every 18 months (similar style to JCAHO) Focuses on the.
Clinical Competency Committees What Faculty need to know Academic Affairs Committee ACEP,JMTF, CORD 1.
Accreditation Council for Graduate Medical Education © 2013 Accreditation Council for Graduate Medical Education Information Current as of December 2,
CLER Pathways II January 28, 2016 PARTNERS IN MEDICAL EDUCATION, INC. Presented by: Tori Hanlon, MS, CHCP GME Consultant.
Fellow Orientation Medical School Residency & Fellowship Examination & Certification Professional Development & MOC Outcomes: Healthy Children.
Comparison: Traditional vs. Outcome Project Evaluative Processes Craig McClure, MD Educational Outcomes Service Group University of Arizona December 2004.
ACGME CLER Visit USF and TGH September 22-24, 2014 Results.
What it Means to be a Program Director Rita M Patel MD Professor of Anesthesiology & Vice-Chair, Education Department of Anesthesiology Associate Dean.
Walk a Milestone in My Shoes for UME: Developing a Milestone Based Assessment Tool to Enhance the Grading Process in Undergraduate Medical Education Kathleen.
Welcome to…... The Single Accreditation System: AOA/ACGME Integration At Last! Judith Pauwels, MD AAFP Residency Program Solutions Consultant.
ADVANCES IN GME: Mastering Accreditation, Learner Assessment, and the Learning Environment Robert B. Baron, MD MS Associate Dean, Graduate and Continuing.
Entrustable Professional Activities: What You Need to Know to Improve Your Residency and Subspecialty Training Patricia Kokotailo, Sarah Pitts, Sheryl.
GME Jeopardy. Compe 10 cies VISA issues ToolboxOversiteAlphabet Soup
Program Director’s Guide to Common Program Requirements Cuc Mai MD GME Director of Faculty Development November 2011.
Introduction to Competency-Based Residency Education Joyce, 2006.
ASH Training Directors’ Workshop “Milestones in Graduate Medical Education” Dec Lee Berkowitz, MD UNC – Chapel Hill.
Program Director Best Practices: Initial Survey Results University of Utah GME Annual Program Director Retreat Susan Stroud, MD Sonja Van Hala, MD, MPH,
Essential component of NAS are the MILESTONES Basis is to track development in the 6 competencies Dreyfus Model: -Novice -Advanced beginner.
Keep Your Eyes on the Dashboard October 15, 2015 Presented by: Candace DeMaris, MAIS Consultant Partners in Medical Education.
Department of Graduate Medical Education (GME) Conflict of Interest Kim Walker – No conflicts of interest to disclose Ann Dohn – No conflicts of interest.
Department of Graduate Medical Education (GME) ACGME Upcoming Site Visit Background Information.
Resident Orientation Medical School Residency & Fellowship Examination & Certification Professional Development & MOC Outcomes: Healthy Children.
The Role of Culture in the Training of Health Care Professionals: A Multidisciplinary Panel Danny M. Takanishi, Jr., MD, FACS Professor and Chair Department.
Core Competency Assessment in Emergency Medicine from Design to Implementation Christian Arbelaez, MD, MPH Assistant Residency Director Harvard Affiliated.
Preparing for the ACGME's Next Accreditation System (NAS) A Prospective View for Family Medicine Residencies Joseph J. Brocato, PhD, University of Minnesota.
Accreditation Council for Graduate Medical Education Nuclear Medicine Review Committee Update SNMMI Winter 2016 Jon Baldwin, DO Chair Review Committee.
Developing an Assessment System B. Joyce, PhD 2006.
“SEE ONE, DO ONE, TEACH ONE” Supervision. Libby Zion Case Issue of work hours galvanized the press and the public and led to subsequent major reforms.
© 2017 SlidePlayer.com Inc. All rights reserved.