Presentation is loading. Please wait.

Presentation is loading. Please wait.

Analyzing CCSSE Data Over Time TAIR 2013, Galveston, TX February 11, 2013 E. Michael Bohlig, Ph.D. Sr. Research Associate CCCSE.

Similar presentations


Presentation on theme: "Analyzing CCSSE Data Over Time TAIR 2013, Galveston, TX February 11, 2013 E. Michael Bohlig, Ph.D. Sr. Research Associate CCCSE."— Presentation transcript:

1 Analyzing CCSSE Data Over Time TAIR 2013, Galveston, TX February 11, 2013 E. Michael Bohlig, Ph.D. Sr. Research Associate CCCSE

2 CCSSE – A brief history of the survey 2 Center established in 2001 Survey item development and revisions through 2004 Main survey has not changed since 2005 Special focus items to address issues of current importance available since 2006 Since 2011, Special item set focusing on Promising Practices

3 Source of information for evidence-based decision-making to improve student engagement and outcomes Once decisions made and programs in place, what next? Have your efforts have paid off? Using CCSSE to help answer this question 3

4 Measuring Change – before you start Implementation– early considerations –Goals achievable within reasonable timeframe? –Are they measurable? –Focus on things the college and staff can directly impact Patience –Implementation dip (Fullan, 2001) –Can take up to 3 years to see positive impact Implementation Fidelity –Cant use CCSSE for this, but changes could be spurious if implementation not monitored 4

5 Planning Your Longitudinal Analysis

6 The Data – Where To Begin At least three administrations since 2005 Benchmarks –CCSSE website: Standardized benchmark scores are not appropriate for longitudinal analysis. –Standardized scores re-standardized every year based on 3-year cohort –Raw benchmark scores – available in download data file. Scale: 0 - 1 6

7 Review: How Benchmarks Are Created 1. Convert benchmark items to a 0 – 1 scale –Items used in benchmarks do not all have same scale –Subtract 1 and divide by the number of response categories – 1 (e.g., [4 – 1]/3). 2. Calculate the average of the 0-1 scaled variables in a benchmark –This is the raw benchmark score. 3. Using full 3-year cohort, standardized scores with a mean of 50 & standard deviation of 25, are created, for each student. 7

8 Standardized vs. Raw Benchmark Scores 8 Standardized BenchmarkYear 1Year 2Diff Active and Collaborative Learning54.6354.03-0.6 Student Effort50.5249.24-1.28 Academic Challenge50.7249.76-0.96 Student-Faculty Interaction54.0651.23-2.83 Support for Learners49.1851.222.04 Raw Year 1Year 2Diff 0.389990.397110.00712 0.460350.464060.00371 0.565120.574570.00945 0.416990.420270.00328 0.415330.451590.03626

9 Standardized vs. Raw Benchmark Scores 9 Standardized BenchmarkYear 1Year 2Diff Active and Collaborative Learning54.6354.03-0.6 Student Effort50.5249.24-1.28 Academic Challenge50.7249.76-0.96 Student-Faculty Interaction54.0651.23-2.83 Support for Learners49.1851.222.04 Raw Year 1Year 2Diff 0.389990.397110.00712 0.460350.464060.00371 0.565120.574570.00945 0.416990.420270.00328 0.415330.451590.03626

10 Driving Benchmark Scores - Means Items from Support for LearnersYear 1Year 2Diff 9bProviding the support you need to help you succeed at this college 3.043.100.06 9cEncouraging contact among students from different economic, social, and racial or ethnic backgrounds 2.312.460.15 9dHelping you cope with your non-academic responsibilities (work, family, etc.) 1.972.090.12 9eProviding the support you need to thrive socially 2.092.270.18 9fProviding the financial support you need to afford your education 2.482.640.16 13a1Frequency: Academic advising/planning 1.711.780.07 13b1Frequency: Career counseling 1.451.41-0.04 10

11 Driving Benchmark Scores - Frequencies 11 Items from Support for LearnersYear 1Year 2Diff 9bProviding the support you need to help you succeed at this college 23.0322.56-0.47 9cEncouraging contact among students from different economic, social, and racial or ethnic backgrounds 60.9553.28-7.67 9dHelping you cope with your non-academic responsibilities (work, family, etc.) 72.6068.97-3.63 9eProviding the support you need to thrive socially 71.2762.92-8.35 9fProviding the financial support you need to afford your education 49.0344.03-5.00 13a1Frequency: Academic advising/planning 40.2937.08-3.21 13b1Frequency: Career counseling 61.6263.622.00 Q9 Items: Percent reported Some or Very little Q13 Items: Percent reported Rarely/Never

12 Longitudinal Analysis - Benchmarks 12

13 Longitudinal Analysis: Item-level 13

14 Longitudinal Analysis: Item-level 14

15 Extending this work

16 Additional work with CCSSE data AIR Forum 2013 – an extension of this presentation in a discussion forum. Center Work –Initiative on Promising Practices. –Strengthening the Role of Part-Time Faculty –Improving outcomes for Men of Color –Validation of SENSE survey –Revalidation of CCSSE survey What can you do at your colleges? 16

17 TAIR 2013 Galveston, TX E. Michael Bohlig Sr. Research Associate Center for Community College Student Engagement bohlig@cccse.org


Download ppt "Analyzing CCSSE Data Over Time TAIR 2013, Galveston, TX February 11, 2013 E. Michael Bohlig, Ph.D. Sr. Research Associate CCCSE."

Similar presentations


Ads by Google