1. A survey of Student Engagement SARAH GRETTON DEREK RAINE CENTRE FOR INTERDISCIPLINARY SCIENCE UNIVERSITY OF LEICESTER 1. Background – AUSSE, HEA 2. Our survey: administration 3. Our survey: overall results and comparison with AUSSE 4. Our survey: selected results from Departments 5. Where next?

2. Student engagement v/s satisfaction based on e.g. Arthur W. Chickering and Zelda F. Gamson "Seven Principles for Good Practice in Undergraduate Education“ STUDENT -- FACULTY CONTACT COOPERATION AMONG STUDENTS ACTIVE LEARNING PROMPT FEEDBACK EMPHASIZE TIME ON TASK COMMUNICATES HIGH EXPECTATIONS RESPECTS DIVERSE TALENTS AND WAYS OF LEARNING Student engagement -> learning gains Why student engagement?

3. Academic Challenge - the extent to which expectations and assessments challenge students to learn (Questions 1s, 2b, 2c, 2d, 3a, 3b, 8b, 10a) Active Learning- students’ efforts to actively construct knowledge (Questions 1b, 1m, 1n, 1p, 1x, 1aa) Staff Student interaction - the level and nature of students’ contact and interaction with teaching staff (Questions 1w, 1y, 1u, 1v, 1z, 6e) Enriching Educational Experience- students’ participation in broadening educational activities (Questions 1ab, 1ac, 6a, 6b, 6c, 6d, 6f, 6g, 6h, 8e, 10c) Supportive Learning Environment - students’ feelings of support within the university community (Questions 7a, 7c, 7e, 7g, 10b, 10d, 10e) Work Integrated Learning- integration of employment- focused work experiences with study (Questions 1j, 5d, 5f, 6b, 11b) The scales of engagement

4. Higher Order Thinking - level of participation in higher-order forms of thinking. (Questions 2b, 2c, 2d, 2e) General Learning Outcomes - development of general competencies (Questions 11 a – 11h) General Development Outcomes- level of development of general forms of individual and social growth. (Questions 11i – 11o) Career Readiness - students’ engagement with their future career, and their involvement in activities such as writing resumes and career planning. (5i – 5m) Departure Intention - the intentions of non-graduating students to leave their institution before completing their qualification. (Question 12) Overall Satisfaction - a student’s overall satisfaction with their education experience at their institution (Questions 14a, 14b, 15). And other things…

5. 14 survey questions from NSSE were used by nine institutions in Spring/Summer 2013, and over 8500 student responses were collected and analysed. Objectives of the project 1. To evaluate the validity and reliability of adapted elements of the NSSE in the UK. 2. To improve our understanding of the levels of student engagement in the UK. 3. To support the participating institutions in using engagement data for enhancement. 4. To raise awareness of the use of engagement surveys for enhancement University of Bath Canterbury Christ Church University Cardiff Metropolitan University King's College London Kingston University University of Oxford University of South Wales University of Warwick York St John University The HEA UK pilot Response rate: 17% (13%-40%) (includes postgrads 10%)

6. Critical thinking Four questions asked students about the emphasis their coursework has placed on a range of mental activities: analysing, synthesising, evaluating and applying information. Course challenge Three questions focused on how hard students have worked and how challenged they have been. Collaborative learning Three questions asked students how often they have interacted with other students in a range of ways. Academic integration Five questions (one of which also appears in the Collaborative Learning group) explored students ‟ interaction with academic staff, participation in class and discussions with others outside class. Scales of Engagement

7. There were marked differences between disciplines, likely to be due to different pedagogies and expectations. E.g. application versus synthesis and evaluation UK students who participated in the UK pilot discussed their career plans with staff much less often than students in the US UK students may have talked to academic staff about ideas from the course more often than students in Australasia. The UK pilot had the lowest proportion of students stating that they had never discussed their academic performance with staff. Selected findings

8. Departments of Computer Science, Physics, English, Sociology, Mathematics and School of Biological Sciences Slightly modified version of the AUSSE student engagement survey “time and effort students devote to educationally purposeful activities and on students' perceptions of the quality of other aspects of their university experience” (widely used in Australasia, similar to measure student engagement, similar to NSSE) Deployed electronically for 6 weeks at the start of the summer term 2013 248 replies were obtained from approximately 3000 questionnaires. The Leicester Pilot

9. Scales of Engagement

10. UoL and AUSSE compared

11. Leicester on-line

12. Work Ethic

13. Support

14. Student Satisfaction

15. HoursDef NoNoYesDef Yes 01201 57113933 102132322 1515148 2014613 250154 300442 >300135 Totals12419488 Average hours worked7.511.810.610.5 A breakdown of responses from students to whether they would follow the same programme with regard to their work regime. More (or less) satisfaction

16. Overall experience

17. In my course, the teaching staff are the most depressing, unenthusiastic and morale sucking people I have ever met. Actually try? As it stands there are possibly two/three lecturers who even come close. It is extremely obvious that they are academics who give little to no thought to lecturing. Some of the teaching staff can be a bit rude and unhelpful to students Get rid of some of the awful lecturers Some free-form comments

18. More comments – somewhat different! Excellent levels of teaching and really great teachers. The lecturers in our department are very charismatic and interact with students outside of lectures, encouraging a passion for the subject My department are supportive, friendly and have made my time at university amazing High expectations and lots of support. They aim for high standards and excellence with each student. How help is available if needed but they also leave us to work if that's how we want to do it. They don't let you suffer in silence.

19. What does this tell us? Students in the same department have very different experiences (bad apples?) Students in the same department have very different expectations (manage expectations?) It’s not a problem of weak students disengaging (personalised curricula?) Your problems might be different

20. Where Next? National HEA Survey based on pilot (with Additional questions) Correlations Critical thinking Course challenge Collaborative learning Academic integration