ERIC KATZ, MD PROGRAM DIRECTOR VICE-CHAIR FOR EDUCATION Graduate Assessment of Programs GLORIA KUHN, DO, PHD VICE-CHAIR FOR ACADEMIC AFFAIRS WAYNE STATE/DETROIT RECIEVING

Are the residents prepared for the real world? How do we know? How can we figure out where our programs need to improve?

ACGME Outcomes Project – Phase 3  Requires programs to use outside sources to prove quality of education.  Requires comparison with a national standard  Dead line for Phase 3, external evaluation, is here

Post-Graduate Assessment  Goals: 1. Evaluation of the program by asking employers how our grads are doing. 2. Evaluation of the program by asking our grads how well they were prepared. 3. Evaluation of specific elements of training that may predict graduate performance. (i.e. what should we be teaching)

Post-Graduate Assessment Methodology Survey the graduate Survey the graduate’s primary employer Survey the program

Obstacles Protect the anonymity of the graduate Protect the rights of the graduate Protect the anonymity of the program

Steps 1. PROGRAM DIRECTOR gets a link by to fill out the PD survey March or April, PROGRAM COORDINATOR gets an stating the PD wants them to enter resident s, employer s and send consents to survey coordinator March or April, Surveys sent to RESIDENTS and EMPLOYERS April, 2011

Step 1 – PD Survey – Defines your program

Step 2 Once the PD completes their survey, it is up to the coordinators  Communication between PD and coordinators matters! Consent forms (available on sharepoint) to be completed prior to graduation and sent to the address on the coordinator link.  Residents can opt out  Hopefully many of you already have these signed

Step 2 – Coordinators – Contact Information

Sending the forms in

Step 3 – Graduates get surveyed

Step 3- Employers get surveyed at the same time

How it will work – your reports You will receive your own program’s results Each program will receive national statistics and comparisons within similar programs Programs will NOT see individual survey results Programs will NOT see other program results CORD/EMARC will NOT see individual program results

The Beta Test The system works Some Unexpected Problems:  Delays in survey completion  Coordinators unaware of project Some expected problems  Spam-blockers  addresses incorrect  Delay/Response rate (not yet known) Louisville Maimonides Maricopa Penn State Synergy Medical Wayne State

What can you do for March, 2011? PLEASE – (if you haven’t already) get the consent off sharepoint and have your 2010 grads sign them. Get your grads address and their new boss’s address.

What can You Do? Communicate with your PD about the project Have a check list to ensure that each step is completed Get the consent forms signed OR Figure out an alternative plan for obtaining external evaluation of your program

Phase 3 of outcomes THE GOAL!

Now is the Time Implement this project Phase 3, external evaluation is here It will be easier to do this as a society than individually

This is the result of dozens of CORD/EMARC members working for over three years. It has had many fits and starts, but we hope this version is feasible for the group as a whole.

Questions?