1. Judith Brenner, MD Associate Dean for Curricular Integration Samara Ginzburg, MD Associate Dean for Medical Education Keith Metzger, PhD Assistant Professor, Science Education Hofstra North Shore-LIJ School of Medicine

3. Discuss general assessment scheme at Hofstra North Shore-LIJ School of Medicine Discuss different uses of formative assessment Discuss integration of competency assessment into our UME curriculum

7. Session Assessment Learning Objectives Competencies EPOs

8. Reflection, Integration & Assessment Weeks

10. Hybrid problem-based/case-based learning pedagogy Students synthesize biomedical science in the context of patient-centered clinical cases with peers PEARLS relies heavily upon formative assessments to help achieve goals of competency based component of program

11. Multiple Perspectives Case SocietyPatient Biologic Science Population Health PreventionTherapy

12. Monday Roles: leader, timekeeper, recorder Patient-centered cases Explore issues and Actively Reason through cases to develop learning objectives Mon-Wed Self Directed Learning Wednesday- Synthesize and apply information with peers in group Wed-Fri/Friday repeat for second case Weekend-complete end of week essay

13. Traditional PBL/CBL Assessment PBL/CBL curricula o Medical Knowledge o Patient Care Challenging competencies o PBL&I o SBP

14. Monday Check-in Monday AM Wed AM Friday AM Self assessment Reflection Practice Based Learning & Improvement

15. Mon/Wed/Fri Wrap-up Monday AM Wed AM Friday AM Self & group assessment Content & process Facilitator framed component Reflection Systems Based Practice

16. Early Formative Meetings ◦ Compare & contrast self with facilitator assessment ◦ Emphasis upon demonstrable changes in areas identified for improvement How am I doing in this curriculum? ◦ Reliance on formative assessments

17. Life-long learners Critical thinkers Patient centered Leaders Teamwork Self-assessment Modification of behaviors Wrap-up discussions around process and system elements Medical Knowledge Patient Care IPS&C Professionalism PBL&I SBP

18. How can formative and summative assessments lead to assessment of competencies?

19. Normal Structure o Gross anatomy o Embryology o Histology Abnormal Structure o Pathology  Gross  Histologic Interventional/ Diagnostic Structure o Medical Imaging o Physical Diagnosis o Ultrasound

20. No pre-work Task (manual) driven Minimal faculty interaction Preparation required Facilitator direct interactions (Socratic) Small groups interact with multiple clinical & basic science faculty

21. Students rotate through stations facilitated by faculty Group dissection ‘cases’ Conducted over 12 weeks Student driven Integrate dissection with other aspects of Structure Student presentations with faculty assessing

22. Assessing multiple competencies in a lab based course supports philosophy of integrated curriculum ‘Effective’ doctoring includes all competencies

23. Traditional Laboratory Course Assessment Typical laboratory courses o Medical Knowledge What other opportunities are there? ?

24. Structure Laboratory Sessions: Weekly o Stations allow immediate and relevant assessment with feedback o Complements PEARLS formative assessment Complex curriculum- How am I doing? How am I relaying Information? Medical Knowledge Interpersonal Skills & Communications

25. Problem-Based Structure o Developmental Program: Assessment transitions from formative to summative o Peer feedback Giving and receiving Practice-Based Learning & Improvement Interpersonal Skills & Communications

26. Routine feedback regarding dissection skills Slight pedagogy adjustments: Incorporate questioning into laboratory discussions If no pre-work, focus on review Formative assessment and feedback: timely, specific, suggests ways to improve, encourages reflection, follow-up

27. Laboratory Exams o Selection and interpretation of clinical tests AB CD Patient Care

28. Laboratory Exams: Same Question, Multiple Scores o Oral Examination Questions o Path Report Interpretation Questions o “Hey doc, can you tell me what all this means? What is this metaplasia stuff? Will it go away?” Medical Knowledge Interpersonal Skills & Communications

29. Problem-Based Structure Presentations o Do not assess Medical Knowledge o Ability to draw resources from literature and interpret scientific work Research & Scholarship o Ability to convey scientific and clinical content coherently Research & Scholarship Interpersonal Skills & Communications

30. MK PC IPCS Prof SBP PBLI RS PH Year 1: Expected level of Competency

31. Formative and summative assessment- when and how much? Shifting perspectives on formative assessment- faculty and students Mapping assessments to competencies Making competencies meaningful- faculty and students

32. Questions