1. Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Director of Persistence & Retention Fort Hays State University 2014 Peer Mentor Institute Fort Hays State University | Hays, KS

2. Overview of Session Learning Outcomes Challenges in Assessment Foundations of a Culture of Evidence Culp & Dungy’s (2012) Building a Culture of Evidence in Student Affairs: A Guide for Leaders & Practitioners Portland State University’s (2011) Division of Enrollment Management & Student Affairs – Assessment Handbook Application to Peer Leader Programs – You’ve Collected Data, Now What Do We Do With it? The FHSU Experience – Go Tigers!! Closing Reflection/Q&A

3. Learning Outcomes By attending this educational session, participants will be able to: Articulate the definition of a “culture of evidence.” Identify the most important data to tell your story with peer leader programs. List strategies for using the data to inform our practice.

4. Background of Institutions Fort Hays State University Regional, comprehensive state university 13,000 total students (5,000 on-campus traditional undergrads) Located in Hays, KS (halfway between Kansas City & Denver) New student cohort (Fall 2013) 950 first year students 450 transfer students 150 international students

5. Background of Institutions Baker University Private, Methodist based university 800 students Located in Baldwin City, KS (1 hour southwest Kansas City) New student cohort 235 first year students 47 transfer students

6. Challenges in Assessment What challenge(s) do you face with your Peer Leader programs regarding assessment? New undergraduate student leaders Returning undergraduate student leaders Undergraduate student staff supervisors Graduate students New professionals Mid-level professionals

7. Foundations of a Culture of Evidence “It is important to be clear about the aims of a culture of evidence. The goal is to use evidence to better understand our students & their experiences so we can improve our work with them.” – Sarah Westfall Kalamazoo College (pg. 2)

8. Risks & Rewards Associated with Creating a Culture of Evidence ChallengeRiskReward Funding Assessment Expertise Competing Priorities Building Capacity Dealing with Fear

9. What is a Culture of Evidence?

10. A commitment among student affairs professionals to use hard data to show how the programs they offer, the processes they implement, & the services they provide are effective & contribute significantly to an institution’s ability to reach its stated goals & fulfill its mission. Source: Culp & Dungy (2012) Building a Culture of Evidence in Student Affairs: A Guide for Leaders & Practitioners

11. What is a Culture of Evidence? What’s the most important assessment data to tell our story? RATHER THAN… What assessment data is available?

12. Application to Peer Leader Programs You’ve Collected Data, Now What Do We Do With It? Analyze, Interpret, Report & Use the Results Fun part! Making sense of data Use it to inform both your practice & decision making Ex.: Look at the characteristics of your respondents. What can you learn to better understand your data? Do responses vary by… Age? Year in school? Cumulative GPA? Read through qualitative comments & reflect on its overall meaning

13. Application to Peer Leader Programs You’ve Collected Data, Now What Do We Do With It? Transparency & Reporting Making meaningful, understandable information about student learning & institutional performance readily available to stakeholders Tie to institutional goals for student learning Draw conclusions that are well-supported & clearly-reasoned Future engagement in assessment cycles

14. Application to Peer Leader Programs You’ve Collected Data, Now What Do We Do With It? Transparency & Reporting Publicly share your assessment plan Publicly share your results Encourage participants’ help in analyzing data Share how conclusions impact program development Highlight assessment results in your annual report Make reports available on departmental websites

15. Application to Peer Leader Programs You’ve Collected Data, Now What Do We Do With It? Transparency & Reporting

16. Application to Peer Leader Programs You’ve Collected Data, Now What Do We Do With It? Using Data – Reflection Questions How do your results provide evidence for your outcomes? What do your results say about your program process & the impact of the program on students’ learning & development? Based on the results, what decisions will you make or what action will you take regarding programs, policies, & services as well as improvement/refinements to the assessment process?

17. Application to Peer Leader Programs You’ve Collected Data, Now What Do We Do With It? Feedback Loops

18. Application to Peer Leader Programs You’ve Collected Data, Now What Do We Do With It? Feedback Loops “Good assessment fosters dialogue, not simply data collection.” – Culp & Dungy (pg. 101)

19. The FHSU Experience ENGAGE College Administered during Weeks 3-6 of UNIV 101 Freshman Seminar Student self-perceptions of behavioral & attitudinal characteristics related to academic success & retention

20. The FHSU Experience ENGAGE College

21. Data shared with variety of campus resources: President’s Senior Administrative Group (ISM) President’s Extended Cabinet Institutional College Completion Team Division of Student Affairs – Directors UNIV 101 Freshman Seminar Instructors Extended trainings with the following: Division of Student Affairs – Student Life Cluster Office of Residential Life Office of First Year Experience/Persistence & Retention – grad/undergrad staff

22. The FHSU Experience ENGAGE College Programmatic Changes Curricular changes in UNIV 101 Development of new extended orientation & transition social connections Policy Changes Academic Affairs – mid-term grade conversations Partner Collaborations Residential Life – revamped programming model around central deficiencies

23. Closing Reflection What is the most important data to tell your story with your Peer Leader program rather than the data that’s most readily available/easily accessible? What is 1 area of refinement for your Peer Leader program as it relates to using the data to inform your practice?

24. Using Data to Inform our Practice with Peer Leader Programs Brett Bruner, Fort Hays State University blbruner@fhsu.edu 2014 Peer Mentor Institute Fort Hays State University | Hays, KS