Assessment Day 2017 New Student Experience Presented by Jenny Lee Heather Ramsier Denise Richardson

Agenda Welcome and Assessment Cycle Overview Data Review Valencia’s Five Year Impact Plan and Our Connection through General Education Facilitated Discussion with Dr. Jamil Johnson Next Steps for Assessment Year 2017-2018 Data Review: We’re going to be looking at our general education outcomes from Fall 2016 and Spring 2017, comparing them to previous years. We’re also going to share data as it relates to our role with helping with the college initiative to increase the graduation rates of our lowest performers (wording???) Dr. Jamil Johnson Bio: Dr. Jamil D. Johnson serves as the Academic Coordinator for the Office of First Year Experience with Student Development and Enrollment Services at UCF. His research interests include Access and Participation in Higher Education of Underrepresented Students and Student Success. His previous experiences include administration, mentoring, and teaching doctoral students at the University of Illinois (UIUC)

Implement Changes: 2017-2018 Academic Year Evaluate Student Work Faculty score student work with rubrics SFI surveys completed Tabulate and Analyze Results: Rubrics are pulled and evaluated Reflect for Improvement: Assessment Day Create a Plan: Task Force Implement Changes: 2017-2018 Academic Year Assessment Cycle **Do we want to change the word task force?

Data Review

Critical Thinking Indicator: use of evidence Fall 2015: MEP Assignment Rubric Data Part 2B: Where am I going (Paragraph)? Number of Students % of total scored in rubrics Satisfactory 2334 73% Developing 500 16% Unsatisfactory 181 6% Part 4: What is my Action Plan? 2186 68% 580 18% 421 13% Total students scored: 3206 57% of enrolled Last year, our data for Critical Thinking reflected: Summer 2015 a team worked to redesign the MEP Assignment which launched in Fall 2015 Increased percentage overall of students scoring in Satisfactory\Developing Increased the percentage of rubric use from Fall 2014 by 20% Total % Satisfactory/ Developing for Critical Thinking: 89% Total % Satisfactory/ Developing for Critical Thinking: 86%

New Year, New You Critical Thinking Indicator: use of evidence Fall 2016: Academic Blueprint Rubric Data New Year, New You Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2874 75% Developing 591 15% Unsatisfactory 361 9% *Total students n= 3864 55% of enrolled 90% Spring 2017: Academic Blueprint Rubric Data The most ever amount of faculty used rubrics in their classes!!! Transition, now we want you to compare Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2616 67% Developing 745 19% Unsatisfactory 545 14% *Total students n= 3906 58% of enrolled 86%

Let’s Review What do you notice? What stands out to you? What are your personal interpretations? Fall 2016: Academic Blueprint Rubric Data Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2874 75% Developing 591 15% Unsatisfactory 361 9% *Total students n= 3864 55% of enrolled Fall 2015: MEP Assignment Rubric Data 90% Part 2B: Where am I going (Paragraph)? Number of Students % of total scored in rubrics Satisfactory 2334 73% Developing 500 16% Unsatisfactory 181 6% Part 4: What is my Action Plan 2186 68% 580 18% 421 13% Total students scored: 3206 57% of enrolled 89% Spring 2017: Academic Blueprint Rubric Data Activity 1: Jot down on the note card what you see, think, know… discuss with the person next to you (Two Minutes) Part 4: Where am I going? What is my Action Plan? Number of Students % of total scored in rubrics Satisfactory 2616 67% Developing 745 19% Unsatisfactory 545 14% *Total students n= 3906 58% of enrolled 86% 86%

Oral Communication Last year, our data for Oral Communication reflected: Summer 2015 a team worked to redesign the Final Story Project which launched in Fall 2015 Levels of Achievement went from 4 (Exceptional, Developed, Acceptable, and Needs Improvement) to 3. Increased percentage overall of students scoring in Satisfactory\Developing Fall 2015: Final Story Project Rubric Data Language\Delivery Number of Students % of total scored in rubrics Accomplished 1706 60% Acceptable 718 25% Unacceptable 99 3% Total students scored: 2848 51% of enrolled Total % Accomplished\Acceptable: 85%

New Year, New You Oral Communication Fall 2016: Final Story Project Rubric Data New Year, New You Language\Delivery Number of Students % of total scored in rubrics Accomplished 2815 72% Acceptable 968 25% Unacceptable 147 4% *Total students n= 3930 57% of enrolled 97% Spring 2017: Final Story Project Rubric Data Note: 77% of the course sections used the rubric in the Fall. Transition, now we want you to compare Language\Delivery Number of Students % of total scored in rubrics Accomplished 2651 69% Acceptable 1001 26% Unacceptable 165 4% *Total students n= 3906 58% of enrolled 95%

Let’s Review What do you notice? What stands out to you? What are your personal interpretations? Fall 2016: Final Story Project Rubric Data Language\Delivery Number of Students % of total scored in rubrics Accomplished 2815 72% Acceptable 968 25% Unacceptable 147 4% *Total students n= 3930 57% of enrolled 97% Fall 2015: Final Story Project Rubric Data Language\Delivery Number of Students % of total scored in rubrics Accomplished 1706 60% Acceptable 718 25% Unacceptable 99 3% Total students scored: 2848 51% of enrolled 85% Spring 2017: Final Story Project Rubric Data Activity 2: Jot down on the note card what you see, think, know… discuss with the person next to you (Two Minutes) Language\Delivery Number of Students % of total scored in rubrics Accomplished 2651 69% Acceptable 1001 26% Unacceptable 165 4% *Total students n= 3817 55% of enrolled 95%

Interpersonal Communication Last year, our data for Interpersonal Communication reflected: Summer 2015 a team worked to redesign the Final Story Project which launched in Fall 2015 Increased the percentage of rubric use from Fall 2014 by 21% Levels of Achievement went from 4 (Exceptional, Developed, Acceptable, and Needs Improvement) to 3. Fall 2015: Final Story Project Rubric Data Language\Delivery Number of Students % of total scored in rubrics Accomplished 2152 76% Acceptable 346 12% Unacceptable 25 1% Total students scored: 2848 51% of enrolled Total % Accomplished\Acceptable: 88%

Interpersonal Communication Fall 2016: CC Personal Connection Fall 2016: Career Interview (online) Language\Delivery Number of Students % of total scored in rubrics Mastery 1748 75% Competent 432 19% Beginning 148 6% *Total students n= 2328 45% of enrolled Language\Delivery Number of Students % of total scored in rubrics Mastery 189 72% Competent 51 19% Beginning 24 9% *Total students n= 264 32% of enrolled 94% 91% Spring 2017: CC Personal Connection Spring 2017: Career Interview (online) Interpersonal Communication Broken Down by Assignment Fall Co-Curricular: 73% course sections ---- Spring Co-Curricular: 64% course sections Fall Career Interview: 61% course sections Language\Delivery Number of Students % of total scored in rubrics Mastery 1750 78% Competent 344 15% Beginning 159 7% *Total students n= 2253 39% of enrolled Language\Delivery Number of Students % of total scored in rubrics Mastery 183 66% Competent 61 22% Beginning 33 12% *Total students n= 277 30% of enrolled 93% 88%

Let’s Review What do you notice? What stands out to you? What are your personal interpretations? Fall 2016: CC Personal Connection and Career Interview (combined) Language\Delivery Number of Students % of total scored in rubrics Mastery 1937 75% Competent 483 19% Beginning 172 7% *Total students n= 2592 43% of enrolled 94% Fall 2015: Final Story Project Rubric Data Language\Delivery Number of Students % of total scored in rubrics Accomplished 2152 76% Acceptable 346 12% Unacceptable 25 1% Total students scored: 2848 51% of enrolled 88% Spring 2017 CC Personal Connection and Career Interview (combined) Activity 3: Jot down on the note card what you see, think, know… discuss with the person next to you (Two Minutes) Language\Delivery Number of Students % of total scored in rubrics Mastery 1933 76% Competent 405 16% Beginning 192 8% *Total students n= 2530 38% of enrolled 92%

Valencia’s Five-Year Impact Plan And our connection as general education.

Personal Reflection Question: Upon reviewing your gradebook you notice that several students have missed 2 or more assignments and/or class sessions. What is your current practice for addressing this concern, if any?

Graduation Rates: By Race and Gender See the Gaps This is why (Slide 18)

Graduation Rates: By Course Success First Five Courses See the Gaps First Five Courses: We know that’s us.

All Valencia Success Rates by Gender/Ethnicity since AY 2014-2015 This is also the first year of NSE required. Institutional Research, High Risk and Grade Distribution Report

All Valencia Success Rates by Gender/Ethnicity Fall 2016 only Institutional Research, High Risk and Grade Distribution Report

SLS1122 Success Rates by Gender/Ethnicity since AY 2014-2015 Institutional Research, High Risk and Grade Distribution Report

SLS1122 Success Rates by Gender/Ethnicity Fall 2016 only The only group on here that is BELOW the average of the past 3 academic years, is our African American Males. So… based on this data, as a team we wanted to look into possible reasons why. Institutional Research, High Risk and Grade Distribution Report

The SFI was reviewed to identify possible correlations between African-American males that earn a D, W, or F and student responses. Students responded positively when surveyed about connecting with peers and receiving support from the instructor. Other positive feedback related to the professor connecting the assignments to the course goals and purpose.

Class Attendance All students taking NSE African-American male students taking NSE that earned a DWF Class Attendance

Completion of Assignments All students taking NSE Completion of Assignments African-American male students taking NSE that earned a DWF

Facilitated Discussion with Dr. Jamil Johnson Dr. Jamil Johnson Bio: Dr. Jamil D. Johnson serves as the Academic Coordinator for the Office of First Year Experience with Student Development and Enrollment Services at UCF. His research interests include Access and Participation in Higher Education of Underrepresented Students and Student Success. His previous experiences include administration, mentoring, and teaching doctoral students at the University of Illinois (UIUC)

So, what we’re being asked to do is to reflect and think what we could be doing to help our under-performing students. The idea is not to only serve our underrepresented student population, but that if we can focus on them, think of interventions that could help, they will help everyone. But we want to do it through the perspective\lens of our underperformers. In NSE’s case, this is our African American males.

Next Steps 2017-2018

Next Steps 2017-2018 The role we as NSE all play cannot be ignored. Please consider being part of the team to continue this discussion and begin formulating strategies for AY 2017-18.

We need to talk about RUBRICS. One last thing… We need to talk about RUBRICS.