Presentation on theme: "Piloting eFeedback on hand-written exams Jon Shute (School of Law), Anna Verges & Andrew Wilson (eLearning Faculty of Humanities)"— Presentation transcript:
Piloting eFeedback on hand-written exams Jon Shute (School of Law), Anna Verges & Andrew Wilson (eLearning Faculty of Humanities)
Faculty perspective Examination remains the second major form of summative assessment across Faculty. Source: Campus Solutions Assessment typeInstances% of total Coursework/Assignment/Essay1,28344.99 Exam74326.05 Presentation2518.80 Test1304.56 Report1083.79 Practical1053.68 Oral802.81 Portfolio692.42 Project652.28 Dissertation240.84 Other 2852
Faculty Perspective Timeliness and quality of feedback on examinations is not only a challenge in large cohorts but arguably a key contributor to student satisfaction and attainment. A small pilot conducted in Criminology shows that electronic delivery of feedback increases student engagement with feedback provided on examinations.
Academic perspective Motives Pilot: LAWS10432 Psychology, Crime & Criminal Justice (n=140- 170) Half the class randomly allocated to receive electronic feedback Feedback comments entered into Excel marking sheet (anonymous/offline) Spreadsheet uploaded into Blackboard
Academic perspective Personal experience & evaluation 37/76 (48.7%) of cohort checked exam score in feedback via ‘My Grades’ in Blackboard No date on paper feedback views Evaluation then and now
Process (Demo) 1. Preparing the Grade Centre hiding the name and surname column in the Grade Centre; create a new column in the Grade Centre and hide it to users (so that grades are not released as marking is underway) 2. Anonymous marking: Marker enters grade and comments via ‘Quick Comment’ in Bb or marks offline using Excel. 3. Not anonymous marking: Marker enters grade and comments via ‘View Grade Details’. A rubric can be created and associated to a Grade Centre column. Marker can mark by either: Entering a grade only Entering comments Ticking a rubric cell 4. Release grades: visibility of grades controlled manually by making Grade Centre column visible or not. No selective release can be set on Grade Centre columns.
Pros & Cons ProsCons Administrative savings for academic and PSS staff Grades can be returned quicker and time to arrange feedback viewing not required Students: No need for students to physically collect scripts with feedback (feedback available online) Increased likeliness that students collect feedback Upload of grades from Bb to CS is uncontroversial Initial time investment required to set up anonymous marking conditions and configure grading sheets - Grade Centre (anonymous, create columns) Anonymity conditions can be easily reverted Protocols are required for online marking to ensure strict observation of student anonymity Offline marking requires full attention to formatting aspects (downloading & uploading from Grade Centre to Excel)
Next steps Larger sample/evidence Expand pilot to other courses Gathering student views on preference for full e-exams vs. hand-written examinations