Survey tools, focus groups and video as a means of capturing student experience and expectations of e-learning Dave O’Hare & Adam Bailey

This presentation will cover Preliminary findings from the survey Strategic institutional synergies Observations on the methodologies used Future developments

Background - University of Derby Post ‘92 University Student-centred mission Leading e-learning provider - 26 full programmes online Strength in work based learning Autumn 2006 participated in e-learning benchmarking exercise….(more info)more info

E-learning benchmarking Measure state of ‘embedding of e-learning’ By gathering range of data around a number of criteria relating to e-learning Further details available via this linklink Derby with its student focused mission, added two additional criteria: –Student experience –Student involvement

Student survey Design supported by our psychology department. Mostly closed responses with few open responses in certain areas Delivered online (copy available here)here Well publicised –To variety of students and campuses

Results How representative was sample? –Checked against enrolment data –Sample broadly matches; level, mode of study, gender and Faculty student numbers –However, there was a slightly elevated representation of postgraduates and distance learners in the sample

Student use of technology Wide range of IT technologies owned by students –Desktop computer 65%, Laptop 59%, MP3/ipod 44%, Web enabled phone 25% Vast majority of students running broadband and wireless connections 92% Only 2% of students without internet connection The most important access to a computer is predominantly their own, followed by a family or University computer

Mode of study Part time students’ spent less time using a computer for their studies than full time students However, part time students spent a longer time logged in to the learning platform Surprising similarity between part time and full time students in: –The frequency with which they logged in –The time periods in which they used the platform

Advantages of online learning Top five reasons cited: 1.Helps me find information for coursework 2.Helps me have control over my learning 3.Ability to learn at own pace 4.Helps me manage the balance of learning, working and home life 5.Enables access to a wider range of source materials

Perceived barriers to online learning Top five barriers by impact: 1.Absence of immediate online access to my tutor 2.Internet connection problems 3.Absence of face-to-face contact with other learners 4.Availability of resources 5.Availability of University computers

Types of online materials students want to see more of 1.Online materials used by courses 2.Web links (URLs) to other useful reading & materials 3.Lecture notes online 4.Online access to tutor 5.Text based material online

Types of online materials students want to see less of 1.Use of webcams 2.Chat rooms 3.Use of blogs/wikis 4.Video conferencing 5.Online labs, simulations, role-play

Student Comments “ Having everything online is good in theory but face to face learning cannot be replaced, no one will effectively learn without teacher input ” “I have been with the University of Derby for 3 years and online resources have been a life saver and have helped me fit studies around a hectic family life with 3 children. Thank you for all the hard work put in to enable us mature students to have a better quality of learning at a pace applicable to us.”

Observations on the survey Useful data obtained from survey But validity remains an issue… Students did value being asked about this - thus useful process in itself, but must tie to action Often the qualitative data provided real insight into benefits and experience not captured via quantitative measures - but analysis of such data is time consuming and challenging

Focus groups Really great idea But could have been more effectively managed and incentivised. Some focused feedback from particular students e.g. Distance learners (!?)

Video booth Open access Well marketed on campus, but low uptake Perhaps in future (if we re-visit this exercise) have UDSU to deliver Use in terms of data gathered - perhaps in this case limited Reticence to be filmed or recorded

Future plans E-learning pathfinder project - with students as stakeholders aims to: –Produce more effective means of engaging with students –Produce models of student participation –Attempt to exploit the existing data as a lever for pedagogic change –Involve students in design of learning

Contact details Dr Dave O’Hare, Senior Teaching Fellow (e- learning) School of Flexible Learning, University of Derby DE22 1GB Adam Bailey - Learning Technologist, University of Derby