2. From Cyclical to Continuous Improvement: Assessment Feedback and Program Metrics Derek J. Herrmann, Coordinator of University Assessment Services Kristen M. Hendrickson, Director of Planning, Research, and Policy Analysis Bruce R. Stoffel, Coordinator of Academic Program and Policy, Office of the Provost

3. Overview Introduction and Context Program Review Assessment Feedback Program Metrics Lessons Learned and Next Steps Questions and Discussion

4. INTRODUCTION AND CONTEXT From Cyclical to Continuous Improvement: Assessment Feedback and Program Metrics

5. About Illinois State University Located in Normal, Illinois Doctoral/Research University Fall 2013 enrollment: 20,272 Programs offered – 71 bachelor’s degree programs – 43 master’s degree programs – 9 certificate programs – 10 doctoral degree programs

6. About Illinois State University Of the 275 programs of study (undergraduate and graduate)… – 139 participate in specialized accreditation – 136 do not participate in specialized accreditation Currently a member of Pioneer Pathways Cohort 2 and completing the Assessment Academy as part of reaccreditation Business intelligence project on campus

7. PROGRAM REVIEW From Cyclical to Continuous Improvement: Assessment Feedback and Program Metrics

8. Program Review Process Eight-year review cycle, 16-17 programs per year Internal reviews by campus committee Facilitated by the Associate Provost Supplements specialized accreditation Follow-up actions may be requested

9. Program Review Schedule

10. Program Review Assessment Feedback Not PresentDevelopingEstablishedExemplary Program goals and student learning outcomes Systematic assessment of student learning Feedback from key stakeholders Use of the Results

11. Program Review Data

13. Impetuses for Change Rapid changes in disciplines and programs Unit requests for more data more frequently Specialized accreditation Data needed to evaluate follow-up actions External pressures – Performance-based funding – Gainful employment disclosures – Competitive recruiting environment

14. ASSESSMENT FEEDBACK From Cyclical to Continuous Improvement: Assessment Feedback and Program Metrics

15. Assessment and Program Review Schedule

16. Process for the Review of Academic Assessment Plans Not PresentDevelopingEstablishedExemplary Program goals and student learning outcomes Systematic assessment of student learning Feedback from key stakeholders Use of the Results

17. Annual Assessment Update Years 4-8: Annual Update for Academic Assessment Plans – Respond to five items based on Higher Learning Commission’s Fundamental Questions for Conversations on Student Learning

18. Annual Assessment Update

21. Years 4-8: Annual Update for Academic Assessment Plans – Previously reviewed by University Assessment Services staff and any concerns were addressed – University Assessment Services staff and Assessment Advisory Council now review and respond to three items

22. Annual Update Feedback

24. PROGRAM METRICS From Cyclical to Continuous Improvement: Assessment Feedback and Program Metrics

25. Academic Program Profiles Development Process

26. Academic Program Profiles

32. LESSONS LEARNED AND NEXT STEPS From Cyclical to Continuous Improvement: Assessment Feedback and Program Metrics

33. Lessons Learned and Next Steps: Program Metrics Ask and you shall receive Expect the unexpected Communication is key Opportunity to educate audiences about the data – seize it!

34. Lessons Learned and Next Steps: Program Metrics Involve faculty from the start Expect difficulty meeting all program needs Anticipate concern about use of data Moving forward … Revise current metrics and add others Integrate with new business intelligence tool Provide units 24/7 access to data Revisit 8-year program review cycle

35. Lessons and Next Steps: Assessment Feedback Be more proactive/outreach more to programs Use the expertise of others Continue to implement feedback process Developing mechanism for incorporating with Program Review

36. QUESTIONS AND DISCUSSION From Cyclical to Continuous Improvement: Assessment Feedback and Program Metrics

37. Questions and Discussion Is there a similar process at your institution? Have you (and/or your colleagues) considered implementing a similar process at your institution? If you have done this at your institution, what are your ‘lessons learned?’

38. THANK YOU! Derek J. Herrmann djherrm@IllinoisState.edu djherrm@IllinoisState.edu Kristen M. Hendrickson khendri@IllinoisState.edu khendri@IllinoisState.edu Bruce R. Stoffel brstoff@IllinoisState.edu brstoff@IllinoisState.edu