Presentation on theme: "IARP Informatics Audio Recording Pilot Dr Apurba Kundu Associate Dean (Learning & Teaching) School of Informatics University of Bradford."— Presentation transcript:
IARP Informatics Audio Recording Pilot Dr Apurba Kundu Associate Dean (Learning & Teaching) School of Informatics University of Bradford
2 IARP, 2006-07 Informatics Audio Recording Pilot (IARP), semesters 1 and 2, 2006-07. Using digital devices to record lectures, seminars and/or presentations, edit the recordings, and then upload them onto the University of Bradford’s VLE (Blackboard) for students to access. IARP located in the University of Bradford School of Informatics: Department of Electronic Imaging and Media Communications (EIMC) Department of Computing IARP co-ordinated by Dr Apurba Kundu, Associate Dean (Learning & Teaching).
3 Origins of the Pilot, 2005-06 “I teach the module ‘Telecommunications and Networking to about 70% of the EIMC final year… This year [2005-06]… I had a large number of students with disabilities, including one who was completely blind, and I concluded that it would be wise to record the lectures. This… turned out to be extremely successful, bringing potential benefits to far more than just the disabled. I bought an Olympus [digital recorder]... Recording the lectures was quite easy… [and] I… became comfortable with the system… and established a routine of editing and saving the files immediately after the end of each lecture… I also recorded my seminar sessions… Once the recording had been converted to MP3 format I then uploaded it to the Blackboard site for this module, simply in a form that the students could download to their preferred device. It was… a considerable surprise…to see the results… where the average was very…high (somewhat over 70%)… On the other hand, last year the average had been the lowest for all of the students concerned (55%) and, while a few minor factors might be identified, the only substantial change from 2005 to 2006 was the use of the audio recording. I asked the students on several occasions whether the audio recordings were useful and they said that they were. The recordings were… strongly praised as being very helpful. Discussions with one of the students with a degree of disability revealed that she had listened to the recordings four times over. I recall other students saying that they had transferred the recordings to their iPods and listened to them on their journey to the University etc. I believe that the German students (of whom there was a significant number) also found it particularly useful… -- Professor Peter Excell, July 2006
4 IARP, 2006-07 At the start, IARP involved: 13 lecturer volunteers (i.e., no workload credit!) A mix of 22 modules –taught at the undergraduate and postgraduate levels, –containing a wide mix of assessments from essays to group presentations, and –varying in class size from 3 to 120 students. Over 500 students were involved. Was IARP successful? By what measure?
5 Quantitative Measures LevelModuleDeptAssessmentsStud 1Audio Visual FundamentalsEIMC75% Exam, 25% Project109 1Creating Virtual RealityComp50% Exam, 50% Gp project3 1Creating Virtual Reality (2nd instance)Comp50% Exam, 50% Gp project10 1Introduction to 3D Animation (Stage 1)EIMC100% Exam77 1Media AudiencesEIMC50% Presentation, 50% Paper12 1Media InstitutionsEIMC75% Essay, 25% Presentation39 2CyberpsychologyComp100% Essay43 2Introduction to 3D Animation (Stage 2)EIMC100% Exam64 2Robotics 4Comp30% Coursework, 70% Exam28 2SoundscapesEIMC50% Ind presentation, 50% Gp project120 2Specialist Project 2EIMC15% Gp proj, 35% Logbook, 50% Product94 3Interactive Systems and Video Game DesignEIMC25% Ind proj&report, 75% Gp proj&report23 3Telecommunications and NetworkingEIMC100% Exam52 MComputer Animation and Special EffectsEIMC25% Report, 75% Coursework20 MDesign for Mobile ContentEIMC60% 2x Projs, 40% 2x Props&Presentations16 MMobile ApplicationsEIMC30% WAP, 30% Proj, 40% 2x Reports16 Ordered by Level (with Department, Assessments and Student Numbers)
6 Quantitative Results LevelModule2005-06 MeanChange in Mean2006-07 Mean 1Media Institutions52.1+ 6.058.1 1Creating Virtual Reality (2nd instance)44.8+ 5.450.3 2Cyberpsychology57.1+ 4.561.6 1Audio Visual Fundamentals47.7+ 2.149.8 MDesign for Mobile Content57.0+ 1.458.4 1Media AudiencesNA 60.2 2Robotics 463.7- 0.862.9 1Introduction to 3D Animation (Stage 1)52.2- 0.951.3 1Creating Virtual Reality44.8- 1.143.7 2Soundscapes53.9- 1.852.1 2Introduction to 3D Animation (Stage 2)56.2- 2.054.2 3Telecommunications and Networking70.3- 2.368.0 2Specialist Project 260.1- 5.354.8 MMobile Applications59.9- 5.854.1 3Interactive Systems and Video Game Design64.2- 8.655.6 MComputer Animation and Special Effects70.9- 9.061.9 Ordered by Change in Mean
7 Quantitative Results LevelModule2005-06 Std DevChange in Std Dev2006-07 Std Dev MMobile Applications8.5+ 10.018.5 MComputer Animation and Special Effects4.5+ 8.112.6 3Telecommunications and Networking15.8+ 5.521.3 1Creating Virtual Reality (1 st instance)13.5+ 5.018.0 MDesign for Mobile Content13.3+ 2.015.3 2Introduction to 3D Animation (Stage 2)9.3+ 1.911.1 1Media Institutions5.8+ 1.67.4 2Soundscapes12.6+ 1.013.6 2Specialist Project 212.6+ 1.013.6 1Media AudiencesNA 13.3 1Introduction to 3D Animation (Stage 1)11.1- 0.810.3 1Audio Visual Fundamentals14.3- 0.413.9 2Robotics 419.3- 3.316.0 1Creating Virtual Reality (2 nd instance)13.5- 4.68.9 2Cyberpsychology15.8- 7.38.5 3Interactive Systems and Video Game Design15.1- 8.86.3 Ordered by Change in Standard Deviation
8 Quantitative Results LevelModuleMeanStd DevStudents 1Media Institutions+ 6.0+ 1.639 1Creating Virtual Reality (2 nd instance)+ 5.4- 4.610 2Cyberpsychology+ 4.5- 7.343 1Audio Visual Fundamentals+ 2.1- 0.4109 MDesign for Mobile Content+ 1.4+ 2.016 1Media AudiencesNA 12 2Robotics 4- 0.8- 3.328 1Introduction to 3D Animation (Stage 1)- 0.9- 0.877 1Creating Virtual Reality (1 st instance)- 1.1+ 5.03 2Soundscapes - 1.8+ 1.0120 2Introduction to 3D Animation (Stage 2)- 2.0+ 1.964 3Telecommunications and Networking- 2.3+ 5.552 2Specialist Project 2- 5.3+ 1.094 MMobile Applications- 5.8+ 10.016 3Interactive Systems and Video Game Design- 8.6- 8.823 MComputer Animation and Special Effects- 9.0+ 8.120 Ordered by Mean, then Standard Deviation, then Student Numbers
9 Student Comments Various modules: “Audio being available was great”. “It was great that podcasts were available”. “Audio recordings of labs [was] very useful”. “Yes I used the podcasts and found them useful”. “[A major strength of the module was the] recorded lectures, so we were able to go back to things we forgot”. “[A major strength of the module was the] audio of lectures on Blackboard”. “Lecture audio via Blackboard is very helpful”. “Just wanted to say thank you for providing such a fantastic module. I feel I got a lot from the audio part of the module… The MP3s were a great help and I found they work on a lot of levels when it comes to reinforcing all the material.” “I used the podcasts and they were useful for refreshing my memory of the lectures”. Robotics 4: student responses Yes % No % Did you use the audio recordings? 50 Did you find them easy to locate on Blackboard? 1000 Did you find them useful? 1000 Did you use them for lectures you attended? 3367 Did you use them for lectures you missed? 8317 Do you think recording lectures is a worthwhile use of lecturer's time? 7525
Lecturer Comments: Negative Three of the 13 original lecturer volunteers (with 4 modules between them) ended up not participating in IARP due to: Late start (recorded only 2 lectures). Insufficient time to manipulate and upload audio files: “I barely got time to download the audio files to my PC let alone edit them and put them as podcast”. Audio unsuited to nature of material being taught. Another lecturer did not use one module intended for IARP due to: Technological difficulties: “Due to [a] lamentable cock-up, I accidentally deleted several recordings in the process of putting them on Blackboard, so I abandoned it for this this module”. Of those who participated, difficulties cited similarly include: Insufficient time: “I found it time consuming and a pain to do the following: Spend 20 minutes transferring data to my machine. Spend an hour or so editing out pauses and partially recorded class-room interactions. Compression to MP3 and upload a further 30 minutes”; “To be honest, I found it a pain and would probably try to avoid it because it took too much time”. Audio unsuited to nature of material: “I think it’s more appropriate to subjects where memorising content from the lectures is likely to directly impact on marks or student learning (where the dictated content of the lectures makes up the key content of what the student needs to know to pass)”. Pointless exercise: “In my view the pilot in this case did not improve on the 'traditional' lecture format other than to edit and refine the actual 'real' presentation. I can't see any reason to replace the lecture with a recording”. Pedagogic concerns: “I am against dictating what type of learning resources lecturers must provide. I reluctantly accept that PowerPoint is now a default requirement. I am worried that students are losing the ability to take notes (a key skill for future meetings etc) and that they don’t bother turning up because they don’t feel they have to – thereby losing out on interaction”.
Lecturer Comments: Positive Lecturers acknowledged that their students found IARP useful: Verbal feedback from the trial was overwhelmingly positive. A number of students indicated that they were using the podcasts and some had subscribed to the podcast RSS feed using itunes. Audio recordings were not just for lectures: “The main use that may have differed from other folk is that I recorded the group meetings from Specialist Project 2 and then put these on line. This had two effects. Firstly it allowed the group to share the discussion with those who couldn't make the meeting and, secondly, it provided a record of who attended. The students said they liked being able to listen to the feedback and guidance later”. “We also recorded the individual project proposals… where the students pitch their own project ideas in small groups to… [two another lecturer] and myself. Recording them meant that our feedback was then available to the project supervisors (allocated after all the presentations had taken place) and subsequently to the students. This meant that there was little chance of anything being missed in that feedback as opposed to written notes being used as the sole record”. Attendance did not seem to suffer: I was “surprised by how many listened and found it useful, even those who attended”. I expected attendance to fall as a result but… even after students… knew podcasts were available they continued to attend well. In sum, “In general I was fairly happy with the podcasts on this module”. “In all it was a positive experience for me, and it seemed to be the same for the students!” I enjoyed participating in the pilot and would definitely podcast lectures again.
Conclusions & Future Studies THE STUDENT EXPERIENCE In line with expectations, the student experience of IARP was almost uniformly positive. Contrary to prior expectations, IARP did not negatively affect attendance. THE LECTURER EXPERIENCE There are more imaginative uses for audio recordings other than simply recording lectures (e.g., recording group discussions and/or marker’s feedback). The technology used— particularly the software—to record, edit and upload files to the VLE was onerous. However, also contrary to expectations, IARP improved the mean of less than half (5 of 16) of those participating modules that had been taught in 2005-06. A WIDER TRIAL? “I am not sure about making podcasts compulsory; I would have thought we would need a more prolonged trial for that…”. DISCIPLINE SPECIFIC APPLICATIONS? IARP involved modules are taught in the respective departments of EIMC and Computing where both students and staff are expected to be comfortable adapting to new technologies. Would students and staff in, for instance, arts & humanities and/or social sciences have the same experience of audio recording technology? Perhaps the nature of delivery in the above are more suited to audio recordings? A LISTENING UNIVERSITY AND ITS AUDIENCE? “A point that is rarely raised in discussion of podcasts is the question of the University's relationship with the wider community. Some US universities make their lectures publicly available and in my opinion this is something… [we] should consider; the question is not just benefits to students directly but also public benefit ("Knowledge Transfer")”.
IARP Informatics Audio Recording Pilot END Please direct comments and questions to Dr Apurba Kundu at firstname.lastname@example.org