Southern Illinois University Carbondale (Go Saluki’s!) First semester General Chemistry (CHEM 200) at SIUC Required in every Dept. in the College of Science and majors in Engineering and Agriculture Typically enrolls ca. 600 students per AY Prior to AY07 taught using a typical large university format → Large lecture sections, typically students → Attendance expected, but not monitored → 4 mid-semester, multiple choice exams, plus comprehensive final → Homework assigned, but not graded → Blackboard used for lecture note and grade posting Historically, the pass rate (C, or better) for CHEM 200 has been poor (40-50%) and is trending downward!

Beginning in AY07 the Department decided to implement 2 major technology-based changes in the delivery of the CHEM 200 course. All students are REQUIRED to purchase the eInstruction Classroom Performance System (CPS) and this system is used in every lecture section. CPS: 10% of grade; typically 1-3 questions / lecture; 1 point for trying / 2 points if correct; peer learning encouraged. All students are REQUIRED to attend weekly, 1-hour, GTA proctored Structured Learning Workshops (SLWs) wherein the McGraw Hill ARIS system is used to deliver algorithmic computer-based problem sets. SLW ARIS: 10% of grade; typically 8-12 questions / 1-hr SLW; peer learning encouraged.

GradeAY06-07%AY07-08% A8112.7%8915.5% B % % C % % D %8514.8% F %9416.4% W8112.7%498.6% Total %Pass52.0%60.2% Analysis of student outcomes shows that the use of this technology resulted in a substantial improvement in student success.

What is the source of the success? Use of the “clicker” allows us to encourage attendance and engage students in the lecture. Required attendance at SLW-ARIS sessions forces students to develop at least minimal study discipline. In-class and SLW-ARIS exposure to relevant problems challenges student perception of “understanding” the material. Small class size SLW-ARIS sessions encourage GA and peer mentoring when comprehension challenges are identified.

Classroom Performance System (CPS) Sample Size: 168 Responses Do the questions asked in lecture requiring an in-class response using your CPS handheld device (aka clicker) help you understand the concepts? a. Never b. Rarely c. SometimesFall 2007:3.53 d. Often e. Always Has the knowledge that you will be asked questions requiring use of the CPS handheld device improved your attendance in lecture? a. Definitely no b. Not sure c. Perhaps d. OftenFall 2007:3.90 e. Definitely yes Did the in class response questions help your final grade in the course? a. Definitely no b. Not sure c. PerhapsFall 2007:3.07 d. Yes e. Definitely yes

Structured Learning Workshop Sample Size: 168 Responses181 Responses Did the questions asked in the Structured Learning Workshops help you understand the concepts? a. Never b. Rarely c. Sometimes d. OftenFall 2007:3.95Spring 2008: 4.13 e. Always Did you find having a teaching assistant present useful when you needed assistance with the questions? a. Never b. Rarely c. Sometimes d. OftenFall 2007:4.44Spring 2008: 4.50 e. Always Did the Structured Learning Workshops help your final grade in the course? a. Definitely no b. Not sure c. Perhaps d. YesFall 2007:3.81Spring 2008: 4.05 e. Definitely yes

Some cost / benefit comments … What is the return? An 8% increase in student success = 50 more students passing CHEM 200 / AY If all students (i.e. 100% rather than 40%) register for 1 additional AY: 30x $10,000 / AY =$300,000 If a proportionate no. (i.e. 70% rather than 40%) complete their degree in 5 years: 15x $10,000 / AY x 3 years =$450,000 If the SLW is turned into a 1 credit hour course 600x $250 =$150,000 What did it cost to do this? Students paid for the clicker, the registration code and the ARIS registration Implementation required 4 $15,000 / 9-month salary = $60,000 Computer lab renovations (one time charge) = $25,000 So, for a ~$90,000 investment there is potentially a $900,000 return!

Thank You! *GRK gratefully acknowledges the support of the SIUC Excellence Through Commitment Teaching Enhancement Award