1. EVALUATION AND THE RESIDENCY PROGRAM Caroline C. Nielsen, Ph.D.

2. POST GRADUATE CLINICAL TRAINING n STRUCTURED LEARNING EXPERIENCE n ASSESS LEARNING OUTCOMES n OBJECTIVE AND EQUITABLE EVALUATION

3. EVALUATION PROVIDES A ROAD MAP THROUGH THE EVALUATION PROCESS RESIDENCY PROGRAM ACCOMPLISHMENTS CAN BE COMPARED WITH OBJECTIVES TO DETERMINE WHAT CHANGES NEED TO ME MADE TO FULFILL THE OBJECTIVES

4. THE EVALUATION PROCESS 1. DEVELOP PROGRAM GOALS 2. DEFINE OBJECTIVES 3. USE EVALUATION STRATEGIES TO DETERMINE THE OUTCOME OF EFFORTS TO MEET OBJECTIVES 4. INTERPRET YOUR FINDINGS 5. MAKE ANY CHANGES NECESSARY

5. EACH RESIDENCY SITE IS UNIQUE n INDIVIDUAL PRIVATE PRACTICES n MULTI- PRACTITIONER PRIVATE PRACTICES n MULTI-SITE PRACTICES n HOSPITAL TEACHING FACILITIES n REHAB CENTERS

6. ALL SITES, HOWEVER DIFFERENT, MUST PROVIDE THE MINIMUM REQUIRED CORE OF SUPERVISED LEARNING EXPERIENCES FOR THE RESIDENT. A SOUND EVALUATION PROCESS FOR BOTH RESIDENCY SITES AND RESIDENTS IS ESSENTIAL FOR ANALYZING AND IMPROVING THE PHILOSOPHY AND STRUCTURE OF THE ORTHOTICS/PROSTHETICS RESIDENCY - AND TO PROVIDE AN EQUITABLE EXPERIENCE FOR ALL RESIDENTS.

7. THE ROLE OF EVALUATION n THE PROCESS OF EDUCATION n RESIDENCY GOALS AND OBJECTIVES n BEHAVIORAL OBJECTIVES FOR THE RESIDENT n EVALUATION PROCESS n DISTINGUISH BETWEEN MEASUREMENT AND EVALUATION

8. STRATEGIES FOR EVALUATING THE RESIDENCY SITE INTERNAL n ONGOING REVIEW OF PROGRAM OBJECTIVES BY STAFF AND RESIDENTS n EXAMINE BALANCE AMONG EDUCATION, RESEARCH AND SERVICE n ENHANCE POSITIVE ATTITUDE TOWARD EDUCATION n USE RESULTS TO IMPROVE PROGRAM

9. STRATEGIES FOR EVALUATING THE RESIDENCY SITE EXTERNAL n SURVEY GRADUATES n PERFORMANCE ON CERTIFICATION EXAM n PEER REVIEW THROUGH SITE VISITS n WORKSHOPS FOR DIRECTORS n USE RESULTS TO IMPROVE PROGRAM

10. EVALUATION IS ONE OF THREE KEY ELEMENTS IN EDUCATION 1. CLEAR OBJECTIVES 2. CLINICAL EXPERIENCES 3. EVALUATION

11. EVALUATING THE RESIDENT EXTERNAL n CERTIFICATION EXAM n RECORD EXAMINATION OUTCOMES n SURVEY GRADUATES, EMPLOYERS n SITE VISITS n PROVIDE FEEDBACK AND ASSISTANCE

12. EVALUATING THE RESIDENT INTERNAL n FREQUENT REVIEW OF DOCUMENTATION AND FEEDBACK n FORMAL WRITTEN REVIEWS n ASSESS DEVELOPMENT IN RESEARCH n STAFF ASSESSMENT n MEET WITH SITE VISIT TEAM

13. STRATEGIES n RESIDENT’S DAILY LOG OR JOURNAL n RESEARCH PROJECT n CASE STUDY ANALYSIS AND DISCUSSION n EXAMINATIONS

14. PURPOSE OF EVALUATION THE PURPOSE OF EVALUATION IS TO IMPROVE THE RESIDENCY PROGRAM AND ENHANCE THE SKILLS OF OUR GRADUATES. “PARTICIPANTS ARE ALLIES NOT ENEMIES.”

15. KEY TO SUCCESS: THE PROGRAM DIRECTOR AS ROLE MODEL AND MENTOR n DEMONSTRATE CLINICAL PROBLEM SOLVING AND DECISION MAKING n PROVIDE CONSTRUCTIVE AND TIMELY FEEDBACK n FREQUENT REVIEWS/EVALUATION FORMS TO ASSESS PROGRESS n INVOLVE STAFF IN EVALUATION n PROVIDE SUPPORTIVE LEARNING ENVIRONMENT

16. TIME?? n HAS TO BE FEASIBLE n RESIDENT’S RESPONSIBILITIES n INVOLVEMENT OF STAFF

17. OUTCOME CLEARLY DEFINED OBJECTIVES + CRITERIA FOR ACHIEVING OBJECTIVES + RESIDENCY DIRECTOR INVOLVED AS MENTOR = EQUITABLE AND OBJECTIVE EVALUATION OF THE RESIDENT ACROSS A VARIETY OF UNIQUE PROGRAMS