1. Improving ABIM Pass Rates A RPNA P ATEL S HYAM R AO M ICHAEL E SKANDER F ARID J ALALI Y UNG L YOU B ETSY L IN Group 1 F ACULTY M ENTOR : D R. B INDU S WAROOP

2. FOCUS F – finding the problem O – organize resources C – clarify goals U – understand objectives S – select a plan

3. B ACKGROUND Scheduling restraints  Little preparedness for ABIM boards Board pass rates lowered

4. 2012-2013 PGY-3 S CHEDULE Average # of inpatient blocks: Overall: 9 In the 2 nd half of the academic year: 4 In the last three months: 2

5. F INDING THE P ROBLEM Board pass rates are falling  How do we fix it?

6. P ARTIES AND R ESOURCES I NVOLVED Norma Hardgrove – collect ITE scores for last 3 years Dr. Swaroop – collect ABIM board scores Chief Residents – organize an intervention Residents – respond to intervention

7. C LARIFY G OALS Improving board pass rate But was it possible? Improving resident knowledge and preparedness Resident-driven Active learning

8. U NDERSTANDING O BSTRUCTION Finding an intervention that would be feasible for busy residents and also promote active learning Getting residents to participate in the intervention Implementing an intervention with the time constraints of the project

9. O PPORTUNITY S TATEMENT An opportunity exists to improve ABIM board scores The process should be improved because board score and the pass rate affect both residents and the program We will know our project has been successful when we see an improvement in resident knowledge, study skills, and eventually improvement in board pass rate

10. S ELECT A P LAN We brainstormed different intervention options including: – Digital MKSAP reviewed by clinic attendings

11. S ELECT A P LAN We brainstormed different intervention options including: – Digital MKSAP reviewed by clinic attendings – Changing resident schedule during 3 rd year

12. S ELECT A P LAN We brainstormed different intervention options including: – Digital MKSAP reviewed by clinic attendings – Changing resident schedule during 3 rd year – Targeting specific residents who would benefit the most from additional board review practice

13. S ELECT A P LAN We brainstormed different intervention options including: – Digital MKSAP reviewed by clinic attendings – Changing resident schedule during 3 rd year – Targeting specific residents who would benefit the most from additional board review practice – Changing board review format

14. S ELECT A P LAN Based on group consensus we decided on a final project: Introducing changes to Friday Academy to change to a resident-driven session

15. PDCA Plan Do Check Act

16. F RIDAY A CADEMY 3 hour protected time for residents on outpatient, elective, and research blocks

17. F RIDAY A CADEMY 3 hour protected time for residents on outpatient, elective, and research blocks Consists of 3 major parts Board review: A.8-10 questions selected by Chief Residents B.Led by chief residents C.Audience participation in answering questions

18. H OW IMPORTANT IS THE FRIDAY ACADEMY BOARD REVIEW TO DIDACTIC EXPERIENCE ?

19. F RIDAY A CADEMY Resident driven topic selection

20. F RIDAY A CADEMY Resident driven topic selection Promote studying of selected topic

21. F RIDAY A CADEMY Resident driven topic selection Promote studying of selected topic Non-intimidating environment

22. F RIDAY A CADEMY Resident driven topic selection Promote studying of selected topic Non-intimidating environment Monitored attendance

23. F RIDAY A CADEMY Resident driven topic selection Promote studying of selected topic Non-intimidating environment Monitored attendance Widespread learning

24. F RIDAY A CADEMY Resident driven topic selection Promote studying of selected topic Non-intimidating environment Monitored attendance Widespread learning ACTIVE learning

25. P LAN Information gathering Post-intervention survey

26. I NFORMATION G ATHERING

27. DODO Discussed with PD and chief residents regarding implementation of this idea

28. DODO Designed the post-intervention survey

29. DODO Discussed with PD and chief residents regarding implementation of this idea Designed the post-intervention survey Started asking residents to present board review during Friday Academy

30. C HECK 74% improvement in “overall experience”

31. C HECK 74% improvement in “overall experience” 52% improvement in “preparedness for ITE and board exams” True Preparedness = ?

32. C HECK 74% improvement in “overall experience” 52% improvement in “preparedness for ITE and board exams” True Preparedness = ? 44% improvement in “understanding of the topic and questions”

33. 59% 37% 70% 56% 44% 55% 66% 52% 41% 78% 59% 74%

34. D O YOU LIKE THE NEW APPROACH OF RESIDENT - DRIVEN BOARD REVIEW ?

35. H AVE YOU ATTENDED AT LEAST ONE SESSION OF THE NEW RESIDENT - DRIVEN BOARD REVIEW ?

36. A CT Overall improvement in the Board Review experience for residents Improved knowledge Improved preparedness for ITE, ABIM boards Permanent Addition Sustainability Mandatory during certain blocks

37. R EFLECT Ambitious idea Time constraints Data gathering Subjective Resident involvement

38. Question ? T HANK Y OU TO ALL R ESIDENTS, C HIEFS, AND P ROGRAM D IRECTOR FOR PARTICIPATING IN THIS EFFORT. T HANK YOU FOR YOUR ATTENTION.