Presentation on theme: "Feedback mechanisms: Efficient and effective use of technology or a waste of time and effort? Dr Robert L Allan Mr Steven Bentley School of Applied Sciences."— Presentation transcript:
Feedback mechanisms: Efficient and effective use of technology or a waste of time and effort? Dr Robert L Allan Mr Steven Bentley School of Applied Sciences University of Huddersfield
Extended Degree Programme (Year 0) Chemistry, Biology, Maths & IT, Physics, H&E, Science Skills ~120 students Feedback mechanisms –Grademark (Blackboard), –proforma, –group debrief, –statistical benchmarking –personal comments, Pressure to provide more but make it personal! Effective? Efficient?
Project (supported by TALI) SPX1005 Maths & IT ~140 students (5 tutorial groups A1, A2, B1, B2 & FCHP) Two assignments (Formative) Assignment 1: CV (2 page) and mini Essay (500 word) Assignment 2: Data Analysis Report (1000 word) Turnitin Grademark (Blackboard – known as UniLearn) Grademark V Audacity
Reflections on the implementation It works, but its not very streamlined Blackboard/Turnitin Integration complications A product like Wimba Voice (now part of Blackboard Collaborate) might be more efficient. –Significant licence costs –Issue with anonymous marking still exists Turnitin Roadmap
Cross over design FeedbackGrademarkAudacity Assignment 1A1, A2 & B1B2 & FCHP Assignment 2B2 & FCHPA1, A2 & B1 Feedback mechanisms Time taken to assess each assignment was recorded
Time taken to assess work Assignment 1Typed (min)Audio (min) Min-Max6-197.0-9.55 Mean (Median) 11.2 (11)8.1 (8.2) Assignment 2Typed (min)Audio (min) Min-Max9.15-13.557.22-12.35 Mean12.2 (12.35)9.55 (10.0)
Questionnaire Easy to follow Highlighted flaws in my overall approach to the assignment Identified specific errors Indicated positive aspects to my work Provided sufficient information on how to improve my performance in future assignments. I have not looked at the feedback only the mark My overall preference is
Questionnaire contd. Additional questions Given your experience of the Science Skills essay on Learning Styles please state which learning preference you have: Have you any suggestions about how the delivery of feedback can be improved?
Response to Questionnaire Typed (Grademark)Audio Responses% % Easy to follow58/668850/6676 Highlighted flaws in my overall approach 50/667648/6673 Indicated specific errors55/668349/6675 Indicated positive aspects to my work 47/667248/6673 Feed forward40/666146/6670 I have not looked at the feedback only the mark 3/66~55/665 Overall preference48/664825/6638
Statistical Analysis Critical values for 2df: *0.05=5.991, **0.01=9.210, ***0.001=13.815 Typed Feedback Audio Feedback χ2χ2 p χ2χ2 p Easy to follow7.8610.020*5.3460.069 Forward feedback12.4060.002**9.6240.008** Positive aspects5.2760.071 5.9380.051 Identifies flaws9.3280.009**5.2160.074 Identifies errors8.9300.012*9.2740.010** Ignored feedback0.6230.732 2.1220.346
Learning Preference Numerous non-standard responses but –62.5% of audio learners preferred audio –25% of audio learners preferred typed –31% of visual preferred audio No statistically significant relationship between learning style and feedback preference
Overview Student preference Typed (inserted where required) Typed good for highlighting errors Audio more fluid style of delivery Both equally effective for highlighting positive aspects and for feed-forward
Issues Anonymous marking Compatibility: Explorer and Blackboard 9 Time consuming to upload onto Blackboard –Size of files 1-6MB (Home Broadband) Student feedback –Tone of voice Future work –Combination Grademark and Audio –Captivate (video V audio)