1. Digging beneath NSS data: what shapes student engagement? Paul Richter (and Sarah Walsh) paul.richter@ncl.ac.uk 1 December 2011

2. 2 Student ‘engagement’ – part of the explanation? Literature: student retention; student success and development; academic achievement; general enrichment of the student experience –‘satisfaction’? 100% to 48% (Q22) NSS 2010 at NU

3. 3 the project: An Exploration of ‘student engagement’ among UGs What? Why? How? Findings Reflections Discussion

4. 4 Why? comparability and generalisability – NSS’ strength (and weakness?) e.g. Q10. I have received sufficient advice and support with my studies “It's sort of casting bread on the waters to a certain extent, you don't know exactly what's making the difference” (Senior Lecturer) How? 6 focus-groups (plus meetings with school staff) stage 2 students – max 10 per group sample (‘high’, ‘middle’, ‘low’- performing subjects 2010 Q22) % 97 - 96 - 96 - 88 - 65 - 48 (average 87)

5. 5 objectives  identify factors relating to (dis-) engagement from the student pov with a view to individual school and institutional learning  deepen understanding of the student experience (as well as the ‘good’/’bad’)  provide opportunity for students to articulate their voice  provide safe context for students to negotiate/debate issues  challenge students to make considered recommendations  reflect results back to schools

6. 6 1. engaging via different learning modes lectures seminars VLE Blackboard /ReCap popular (esp. natural and medical science) “He was absolutely brilliant. He let us actually do stuff, make stuff, make it work as [practitioners of the subject], instead of theory, theory, theory.” “And he told us about what he was researching, which was interesting.” (applied science) “I think seminars would work a bit more because a lot of the time they try to incorporate that into the lectures, so we're sitting trying to learn and then at 9 o'clock in the morning the lecturer is, 'Right, what do you think about all this?' and nobody ever answers them and you feel a bit awkward” (humanities) “After about one hour of lectures, everyone becomes ‘disengaged’!” (applied science)

7. 7 practice-based learning lab-work –mixed experience of demonstrators fieldtrips They sort of make your degree seem more worthwhile… Obviously I'm learning [in lectures] but what am I actually paying for? (natural science) It's great to see the lecturers having fun as well and they really get into it and you can tell it's what they love to do. And I think it's when you've got enthusiastic lecturers, you start getting really enthusiastic about it too. (natural science) I think it's really important on our course to do more hands on stuff to do with building, actually with our hands instead of just drawing details etc. (humanities) You have more connection with them because they are a lot younger and you can have a bit of a laugh as well as being serious with them. (natural science)

8. 8 2. engaging with staff They are so friendly, they are. (Agreement). The department is just fantastic, amazing I think they really do enjoy their job, which is nice.. And they are all so chilled out as well. My friends on other degrees say that their lecturers get angry… It's like, you ask housemates about their degrees and they'll say they don't really know their lecturers or they don't really respond. They know each other really well and are a really good team and they work hard. It's interesting because I…see both schools, and [one] sounds like a group of professionals working individually under each single unit, but [mine], they are like a team. I've yet to find somebody that's unenthusiastic about it…all of my lecturers…you can tell by the way they talk about it and the way they want you to get involved in it… Some people have lectures with about 200 plus people…so I wouldn't like that. Facilitator: And are they friendly here? (humanities)

9. 9 how more relaxed we'd like it to be between the students and the tutors …and not having this formal thing. I think it's really important for your education because you can learn so much from them…and having discussions everyday…makes the School a happier place. (Agreement) (humanities) engaging with staff research “[office hours are] a good idea because you feel like you're not inconveniencing them. Yes, like you're not taking their time, it's specific. You're not interfering in their research life Facilitator: Do you feel that - that in some ways you might kind of interfere and that they have busy research lives…? I do. (Agreement). They don't make you feel like that though… obviously a lot of them are research scientists as well as lecturers, as well as marking work, running labs, and so you do feel like, 'Should I email them? Should I make an appointment?' and you don't want to encroach on their time, but I mean, that's not a reflection of them at all.” (natural science)

10. 10 personal tutor system –often seen as quite poor (across subjects) –some sessions valuable if activity-oriented (applied science tutor groups) –significance may depend on compensating structures? socialising with staff [our Society] does loads of things…and lecturers actually do involve themselves, and they're having a Ball, where some of the lecturers have actually bought tickets to that as well and there's secretaries as well in the student office [coming]… (natural science)

11. 11 desire for engaging with practitioner guests experiencing the real world of practice “Just help with getting work experience, if there was only 40 [students] or whatever, surely it's not that hard to set up some contacts” Facilitator: “So in your second year now, for example?” “Yes.” (Agreement). “We could even do one or two days a week or something. (Agreement).” “They don't really pressure you into doing any formal work experience at all” “Or internships.” “Yes…if they were to promote it more, like, say that you should, then you would” (humanities) 3. engaging beyond the university...a seminar led by someone in the profession…yeah, just a small group thing where you could ask them questions and stuff (humanities)

12. 12 union Societies –quite low involvement social space –appreciated where exist / demanded where absent senior peers –mentoring / ‘parenting’ schemes work well where exist I think it would be really good if we could encourage that, a stronger relationship between the years. it's so vital because you learn [our subject] through experience and those little pieces of advice from the higher level years are completely vital to point you in the right direction (humanities) They look like us, they think like us and they're not that much older than us and they appreciate what you need to know… (medical science) 4. engaging with peers

13. 13 staff seen to be willing to listen to/act on student concerns mixed success in modes of eliciting/giving feedback –innovative modes (e.g. wall-mounted sheets; focus group) –SSCs often less engaging –closing of feedback loop welcomed –relevance may depend on compensating structures? altruism vs apathy NSS not on their radar (now or on application) it doesn't really directly affect us…only subsequent years so…you just think, 'Well why should we even bother complaining cos it’s not gonna change our experience…?' (medical science) 5. engaging with student feedback mechanisms even if they can't do it immediately…you know that it might occur a couple of years down the line and help the year below (natural science)

14. 14 characteristics influencing degree of student engagement 1.‘good’ staff-student relationship 2.supportive learning-oriented peer relationship 3.practice-oriented/‘hands on’ experiences feeling listened to interesting lectures quality VLE use social activities with peers ‘value for money’ applies knowledge increases confidence valuable career experience intimacy facilitates closer relationship (even nurturing) relevant assessments ‘value for money’ inspires teacher/practitioner passion = enthusiastic students

15. 15 teacher/practitioner-student nexus: implications positive impact on satisfaction? personal respect for teacher/practitioner (and for student) greater empathy for teacher/practitioner dissipation of common concerns (e.g. marking inconsistencies...)? only vocational subjects?good news for NU? findings question ‘myths’ about satisfaction factors (high contact hours; small cohort size; strong identity)

16. 16 questions… Do these data aid triangulation from other sources? Do findings facilitate action? (school engagement workshops well received) Is the NSS an adequate measure of engagement? (NSSE?)