1. Operation STEM Cleveland State University February 22, 2014

2. Operation STEM Cleveland State University February 22, 2014 What is Operation STEM? Changes in PreCalculus Program SPT Sessions Additional Support Benefits of Operation STEM Impacts of the Program Data/Statistics Students STEM Peer Teachers Questions Agenda

3. Operation STEM Cleveland State University February 22, 2014 What is Operation STEM? Overview and Background  The purpose of NSF-STEP grants is to increase the number of STEM graduates in U.S. Colleges and Universities.  Operation STEM was created at CSU to increase the number of students who successfully complete the calculus sequence (PreCalculus – Calculus) and graduate with a STEM degree.

4. Operation STEM Cleveland State University February 22, 2014 PreCalculus Program Changes Operation STEM targets FTFT* Freshman pursuing a STEM degree, and provides them with:  A community of peers  Class size capped at 37 students  Preparation & assistance in Precalculus and Calculus Mandatory 2 extra hours per week of structured learning assistance Project Based Learning / Application Problems STEM Peer Teacher (SPT) instruction, mentoring, and personal attention   *FTFT = First Time Full Time

5. Operation STEM Cleveland State University February 22, 2014 PreCalculus Program Changes SPT Sessions  SPT Session - 1 hour structured learning assistance session twice a week taught by STEM Peer Teachers  STEM Peer teachers reinforce PreCalculus concepts  Concepts are enforced and applied using Project/Problem Based Learning

6. Operation STEM Cleveland State University February 22, 2014 PreCalculus Program Changes Additional Support  Mandatory and Optional Office Hours  Study Sessions  Exam Preparation Sessions  Homework Help  Supplemental Worksheets, Activities, and Videos

7. Operation STEM Cleveland State University February 22, 2014 Benefits of Operation STEM OpSTEM Scholars 2-weeks, 8-days Immediately before start of Fall semester They engaged in:  Explore CSU Activities  Visits from STEM Guest Speakers  College Success Workshops  A Review of Precalculus Skills Summer Institute 2013

8. Operation STEM Cleveland State University February 22, 2014 Benefits of Operation STEM OpSTEM Scholars  Academic Support & Mentoring for Precalculus I & II  Summer Calculus I  OpSTEM Scholar Outings

9. Operation STEM Cleveland State University February 22, 2014 How have these changes impacted the PreCalculus Courses, SPTs, and Students thus far?

10. Operation STEM Cleveland State University February 22, 2014 Impacts of Operation STEM 2013 Summer Institute  Refreshed PRE-Precalculus skills -- more prepared for Fall Precalculus I course  Increased knowledge of:  CSU resources, organizational & time management skills, how to interact with professors  STEM Guest Speakers: positive, encouraging & influential; provided helpful career information

11. Operation STEM Cleveland State University February 22, 2014 Impacts of Operation STEM 2013 Summer Institute cont.  OpSTEM Scholars were more confident on first day, fewer “unknowns”.  Bonded as a cohort  STEM Peer Teachers have gained valuable teaching, coaching, mentoring, organizational skills, and work experience.

12. Operation STEM Cleveland State University February 22, 2014 Impacts of OpSTEM Results of Our First OpSTEM Semester  Over the 6 years at CSU, highest Precalculus I pass rate: 66%.  Pioneer semester of Operation STEM, Fall 2013, surpassed that rate by 15%.  Fall 2013 Precalculus I pass rate: 81%

13. Operation STEM Cleveland State University February 22, 2014 TermEnrollment * Withdrawals (Percentage & Number ) Pass Rate (Percentage & Number Passed with C or >) Fall 200714014% (19)49% (69) Spring 20081059% (9)50% (52) Fall 200813819% (26)46% (64) Spring 200912617% (21)49% (62) Fall 200913416% (21)51% (68) Spring 201012117% (21)60% (73) Fall 201012216% (20)56% (68) Spring 20119423% (22)51% (48) Fall 201112717% (22)57% (72) Spring 20127330% (22)40% (29) Fall 20121349% (12)66% (89) Spring 20139313% (12)57% (53) Fall 2013**1525% (8)81% (123) *Includes all official and unofficial withdrawals for MTH 167.

14. Operation STEM Cleveland State University February 22, 2014 *Enrollment of OpSTEM Scholars in Precalc I section. **Includes official and unofficial students who withdrew from the course. Fall 2013 MTH 167 Section OpSTEM Section (Enroll- ment*) PBL Sect. Course Enroll- ment** %/No. Withdraws # Who Took Final & Completed the Course Pass Rate (Percentage C or >) Official Un- official 9:45am–10:50am MWF 11:00am–12:05pm SPT/PBL-MW YES (13) YES37 3% (1) 14% (4) 32 84% (31) 4:00pm – 5:50pm MW 6:00pm-7:00pm SPT/PBL-MW YES (8) YES28 4% (1) 11% (3) 24 82% (23) 1:30pm – 2:35pm MWF 3:00pm – 4:00pm SPT-MW YES (8) NO32 16% (5) 0% (0) 27 72% (23) 2:45pm-3:50 MWF 4:00pm-5:00pm SLA-MW NO 25 4% (1) 0% (0) 24 84% (21) 8:00am-9:50am TTH 10:00am-11:00am SLA-TTH NO 30 0% (0) 7% (2) 28 83% (25) TOTALS3/52/5152 5% (8) 6% (9) 135 81% (123)

15. Operation STEM Cleveland State University February 22, 2014 Cohort # of Students* %/Number of Withdraws Mean Final Exam Score Mean Course Grade Pass Rate (Percentage & Number of Students with C or >) Moved on to Precalc II MTH 168 OpSTEMS *** 29 0% (0) 79%85% 90% (26) 24** Non- OpSTEMS 123 6.5% (8) 71%78% 79% (97) 88 *Includes all official and unofficial students who withdrew from the course. ** Changed major, difficult high school-freshman transition, life challenges, etc. *** Students who attended the Summer Institute

16. Operation STEM Cleveland State University February 22, 2014 Cohort # of Students* %/Number of Withdraws Mean Final Exam Score Mean Course Grade Pass Rate (Percentage & Number of Students with C or >) OpSTEM Scholars ** PBL21 0% (0) 79%84% 86% (18) Non -PBL 8 0% (0) 80%88% 100% (8) Non- OpSTEM Scholars PBL44 5% (2) 69%79% 82% (36) Non -PBL 79 8% (6) 73%78% 77% (61) *Includes all official and unofficial students who withdrew from the course. ** Students who attended the Summer Institute

17. Operation STEM Cleveland State University February 22, 2014 2013 MTH 167 Precalculus I Survey Feedback If you took another mathematics course, would you take it with or without the SPT session? 34% WITH WITHOUT 66%

18. Operation STEM Cleveland State University February 22, 2014 2013 MTH 167 Precalculus I Survey Feedback Did you benefit from the SPT/SLA sessions? YESNO 83% 17%

19. Operation STEM Cleveland State University February 22, 2014 Impacts of Operation STEM STEM Peer Teachers (SPTs) confidence in teaching abilities expanded understanding of topics hands-on training contact hours collaboration with professors designing lessons

20. Operation STEM Cleveland State University February 22, 2014 Impacts of Operation STEM Students Questions we asked students: How has Operation STEM impacted your math career? How well do you think you would have done in PreCalculus I without the assistance provided by Operation STEM? How has Operation STEM impacted your life outside of your math career?

21. Operation STEM Cleveland State University February 22, 2014 How has Operation STEM impacted your math career? Impacts of Operation STEM - Students “Having multiple people in the classroom allowed me to get my questions answered quickly and with different explanations.” – Precalculus Student “With Operation STEM it has made it easier to follow along in class, often in college classes many students don’t get the help they need but everyone does in SPT classes!” – Operation STEM Scholar

22. Operation STEM Cleveland State University February 22, 2014 How has Operation STEM impacted your math career? Impacts of Operation STEM - Students “It has made me consider math as my major!” – Operation STEM Scholar

23. Operation STEM Cleveland State University February 22, 2014 How well do you think you would have performed in PreCalculus I without the assistance provided by Operation STEM? Impacts of Operation STEM - Students “Operation STEM provides a one-on-one hands on learning experience that is extremely helpful. Without them, I’d do mediocre.” – Precalculus Student “I feel as though my motivation would not even compare to the motivation I have now.” – Operation STEM Scholars

24. Operation STEM Cleveland State University February 22, 2014 How has Operation STEM impacted your life outside of your math career? “Mainly, I don’t stress about the material like I used to. Operation STEM gave me back the confidence in the material and even some in myself.” ~Precalculus Student Impacts of Operation STEM - Students

25. Operation STEM Cleveland State University February 22, 2014 How has Operation STEM impacted your life outside of your math career? Impacts of Operation STEM - Students “I am a better problem solver and I am looking for multiple ways to calculate problems I come across, instead of just focusing on just one way I was taught previously.” – Operation STEM Scholar

26. Operation STEM Cleveland State University February 22, 2014 How has Operation STEM impacted your life outside of your math career? Impacts of Operation STEM - Students “I have gained confidence in my ability to do college work and I have made great friends.” – Operation STEM Scholar

27. Operation STEM Cleveland State University February 22, 2014 Observed, Unique Characteristics of OpSTEM Scholars Sense of community has been established in lecture, SPT session, and on campus Support and look out for one another Evident tone of overall strong, focused work ethic in class

28. Operation STEM Cleveland State University February 22, 2014 Observed, Unique Characteristics of OpSTEM Scholars Feel special (social activities and special opportunities) Cohort has bonded (due to Summer Institute, OpSTEM Scholars placed in same Precalculus sections, social activities)

29. Operation STEM Cleveland State University February 22, 2014 Thank you! Questions? “Working hard for something we don’t care about is called stress; working hard for something we love is called passion.” ~Simon Sinek, Notes to Inspire