1. Student Engagement: 2008 National Survey of Student Engagement (NSSE) Office of Institutional Research and Planning Presentation to Senate November 2008

2. 2 What is NSSE? Developed by the Indiana University Center for Postsecondary Research Based on many years of US research into the outcomes of a high-quality education Survey items represent empirically confirmed good practices in undergraduate education In use in US since 1999 (769 universities in 2008) In use in Canada since 2004 (10 universities, including Carleton) All 19 Ontario Universities participated in 2008.

3. 3 What is NSSE’s focus? First-year and graduating students are surveyed Questions address curricular (in-class) and co-curricular (out-of-class) experiences Questions include clusters addressing NSSE’s five Benchmarks of Effective Educational Practice:  Level of Academic Challenge (LAC)  Active and Collaborative Learning (ACL)  Student-Faculty Interaction (SFI)  Enriching Educational Experiences (EEE)  Supportive Campus Environment (SCE)

4. 4 2008 NSSE at Carleton In February 2008 Carleton participated in NSSE for the fourth time. All first-year and final-year undergraduates were invited to complete the survey.  A total of 3,774 students responded to the survey: −49% response rate −2,103 first-year students, −1,671 final-year students  Large enough sample size to do analysis by subgroups

5. 5 Analysis done so far of 2008 NSSE Summary of Carleton Results  Benchmarks, overall impressions, quality of relationships, Ontario Consortium questions.  Comparisons to Ontario Consortium and 2006 Results by Academic Faculty  Similar to analysis done in summary

6. 6 NSSE 2008: First-Year Mean Benchmark Scores Carleton 2008 Carleton 2006 Rest of Ontario 2008 Level of Academic Challenge 50.350.251.4 Active and Collaborative Learning 34.835.235.3 Student-Faculty Interaction 24.123.123.5 Enriching Educational Experiences 25.124.325.0 Supportive Campus Environment 56.856.555.9 Shading denotes a statistically significant difference from Carleton.

7. 7 NSSE 2008: Final-Year Mean Benchmark Scores Carleton 2008 Carleton 2006 Rest of Ontario 2008 Level of Academic Challenge 57.355.555.8 Active and Collaborative Learning 42.642.844.1 Student-Faculty Interaction 32.430.232.8 Enriching Educational Experiences 33.332.734.9 Supportive Campus Environment 53.350.251.4 Shading denotes a statistically significant difference from Carleton.

8. NSSE 2008: How would you evaluate your entire educational experience at this institution? 8

9. NSSE 2008: If you could start over again, would you choose the same institution? 9

10. NSSE 2008: Quality of Relationships With… 10

11. Differences in Quality of Relationships Other Students: 2008 First-Year Carleton > 2008 Ontario First-Year Administrative Personnel and Offices: 2008 Final-Year Carleton > 2008 Ontario Final-Year AND 2008 Final-Year Carleton > 2006 Carleton Final-Year 11

12. 12 Biggest Obstacle to Academic Progress Carleton and the Rest of Ontario First-Year Respondents Carleton Ontario (excluding Carleton) Financial pressures or work obligations 28%24% Your academic performance at university 25%29% Family/personal problems or obligations 12%14% Not applicable/you have faced no obstacles 13%12%

13. 13 Biggest Obstacle to Academic Progress Carleton, by Faculty First-Year Respondents Arts& SocSc Public Affairs BusinessScience Engineer. & Design Financial/ work pressures 32%28%27%26%27% Academic performance 21%27%26%30%26% Family/personal problems or obligations 15%11%13%9%8% Not applicable/ no obstacles 12% 13%10%17%

14. 14 Biggest Obstacle to Academic Progress Carleton and the Rest of Ontario Final-Year Respondents Carleton Ontario (excluding Carleton) Financial pressures or work obligations 34%29% Family/personal problems or obligations 14% Your academic performance at university 12%15% Not applicable/you have faced no obstacles 11%

15. 15 Biggest Obstacle to Academic Progress Carleton, by Faculty Fourth-Year Respondents Arts& SocSc Public Affairs BusinessScience Engineer. & Design Financial/ work pressures 40%35%24%31%33% Family/personal problems or obligations 15%13%12%16%11% Academic performance 10%8%12%13%11% Not applicable/ no obstacles 11%15%16%13%16%

16. 16 University Most Needs to Address… in Class First-Year Respondents Carleton Ontario (excluding Carleton) 1 Improving the quality of teaching assistants (28%) Ensuring a better fit between course content, assignments and tests/exams (26%) 2 Improving the quality of course instruction by profs (24%) Improving the quality of course instruction by profs (25%) 3 Ensuring a better fit between course content, assignments and tests/exams (21%) Improving the quality of teaching assistants (22%)

17. 17 University Most Needs to Address… in Class Ranked by Faculty for First-Year Respondents Arts & Social Science Public AffairsBusinessScience Engineering & Design 1 Increase courses in major (28%) Better fit between content/tests (23%) Course instruction by profs (35%) TAs (44%) TAs (41%) 2 TAs (21%) TAs (22%) TAs (32%) Course instruction by profs (23%) Course instruction by profs (35%) 3 Better fit between content/tests (20%) Course instruction by profs (21%) Better fit between content/tests (20%) Increase courses in major (17%) Better fit between content/tests (22%) Increase courses in major (21%) Better fit between content/tests (17%)

18. 18 University Most Needs to Address… in Class Final-Year Respondents Carleton Ontario (excluding Carleton) 1 Increase course offerings in your major (35%) Increase course offerings in your major (34%) 2 Improving the quality of course instruction by profs (28%) Improving the quality of course instruction by profs (29%) 3 Improving the quality of teaching assistants (21%) Ensuring a better fit between course content, assignments and tests/exams (21%)

19. 19 University Most Needs to Address… in Class Ranked by Faculty for Fourth-Year Respondents Arts & Social Science Public AffairsBusinessScience Engineering & Design 1 Increase courses in major (48%) Increase courses in major (30%) Course instruction by profs (46%) Increase courses in major (32%) Course instruction by profs (36%) 2 Classrooms and lecture halls (21%) Course instruction by profs (28%) Increase courses in major (31%) Improving quality of labs (27%) TAs (34%) 3 Course instruction by profs (20%) TAs (20%) TAs (23%) TAs (25%) Increase courses in major (26%) Reducing class sizes (20%)

20. 20 University Most Needs to Address… Out of Class First-Year Respondents Carleton Ontario (excluding Carleton) 1 Improving the quality/availability of study space (31%) Improving the quality/availability of study space (30%) 2 Increasing contact with professors outside of class (24%) Increasing contact with professors outside of class (26%) 3 Working to provide a better social environment for students (22%) Expanding/improving the quality of academic support services (23%)

21. 21 University Most Needs to Address… Out of Class Ranked by Faculty for First-Year Respondents Arts & Social Science Public AffairsBusinessScience Engineering & Design 1 Study space (33%) Study space (30%) Study space (32%) Study space (34%) Study space (31%) 2 better social environment for students (23%) Increased contact with profs outside class (22%) Increased contact with profs outside class (24%) Increased contact with profs outside class (28%) Increased contact with profs outside class (29%) 3 Increased contact with profs outside class (22%) better social environ. (21%) Provide better social environment for students (24%) Research with faculty (25%) Research with faculty (22%) Acad. Support serv. (21%) better social environment for students (22%) Opp. for int’l experiences (21%)

22. 22 University Most Needs to Address… Out of Class Final-Year Respondents Carleton Ontario (excluding Carleton) 1 Improving the quality/availability of study space (39%) Improving the quality/availability of study space (34%) 2 Providing students with more opportunities to undertake research with faculty (33%) Providing students with more opportunities to undertake research with faculty (32%) 3 Working to provide a better social environment for students (17%) Expanding/improving the quality of academic support services (18%)

23. 23 University Most Needs to Address… Out of Class Ranked by Faculty for Fourth-Year Respondents Arts & Social Science Public Affairs BusinessScience Engineering & Design 1 Study space (42%) Study space (40%) Study space (48%) Study space (39%) 2 Research with faculty (34%) Research with faculty (30%) Provide better social environ. for students (21%) Research with faculty (44%) Research with faculty (36%) 3 Improve library collection (26%) Provide better social environment for students (20%) Research with faculty (20%) Academic support (13%) Contact with profs. outside class (18%) Contact with profs. outside class (13%) Better social env. (13%)

24. 24 NSSE 2008: Next Steps Work with the newly established NSSE Advisory Committee to identify priorities for further analysis More presentations (Faculties, Senate, CASG)

25. 25 Questions about NSSE? For more information about NSSE, please go to nsse.iub.edu For more information on Carleton University, and the results of the surveys in which it participates (including NSSE), please go to www.carleton.ca/oirp or contact: Nathasha Macdonald in the Office of Institutional Research and Planning nathasha_macdonald@carleton.ca or ext 4473.www.carleton.ca/oirp nathasha_macdonald@carleton.ca

26. 26 Appendix The NSSE Benchmarks

27. 27 Level of Academic Challenge Challenging intellectual and creative work is central to student learning and university quality Universities promote high levels of achievement by setting high expectations for student performance Eleven items, including:  Preparing for class  Reading and writing  Using higher-order thinking skills  Institutional environment that emphasizes academic work

28. 28 Active and Collaborative Learning Students learn more when they are more actively involved in their education Collaborating with others prepares students to handle practical, real-world problems. Seven items, including:  Asking questions in class  Making presentations  Working with other students on projects  Discussing ideas from readings or classes with others

29. 29 Student Interactions with Faculty Interacting with experts shows students first-hand how to think about and solve practical problems Teachers become role models and mentors for learning Six items, including:  Discussing assignments with a professor  Talking about career plans with faculty member or advisor  Getting prompt feedback on academic performance  Working with a faculty member on a research project

30. 30 Enriching Educational Experiences Learning opportunities that complement the goals of the academic program Provide opportunities to integrate and apply knowledge Twelve items, including:  Experience diversity  Using technology  Participating in internships  Culminating senior experience

31. 31 Supportive Campus Environment Students perform better and are more satisfied at colleges that are committed to their success Does institution cultivate positive working and social relationships among different groups on campus? Six items, including:  Helps students achieve academically  Helping students cope with non-academic responsibilities  Promoting supportive relationship between students and peers, faculty, and administrative personnel