1. Electronic marking and feedback using GradeMark Digital Services Workshop 2015 Cartoon by Bob Pomfret © Oxford Brookes University

2. Session Outline  What is GradeMark and why use it?  What is it like to use?  What the tutor sees  What the student sees  What are the pros and cons?  Is there anything else I need to bear in mind?  Can I have a go?

3. GradeMark Overview Hosted by Turnitin Runs in Moodle Functions include QuickMarks (bank/set of module comments) General Comments (5000 characters) In-line comments (linked to highlighted text) Rubrics (with grade calculation) Grading (adds to Moodle grade book) Audio feedback (feed-forward)

4. Locate a set of assignments

5. What does the tutor see? Submissions can be searched by author, similarity percentage or submission number Tutors click on pen icon under grade Indicates student has collected the marked assignment

6. What does the tutor see? GradeSimilarity score QuickMark set Comments Add general comment Add rubric

7. What does the student see? Originality report General comments section Audio- feedback Switch between Originality & GM In-text comments In-text comment about highlighted text Rubric Grade

8. Activity 1: Review a marked up assignment  Open the exemplar assignment titled ‘Activity 1 – a marked up assignment to review’  Check all of the markers’ feedback and grades  Use the GradeMark functions to give written feedback Discussion: What might you need to consider if you are working as part of a marking team?

9. Pros Paperless No need for students to submit or collect in person More readable feedback for students Richer feedback is possible High levels of control over release of grades & feedback Easy access for second markers and external examiners Range of multi-modal feedback/feed-forward options Easy to use Can save marking time Allows for peer evaluation (observation) of marking across a module/programme Marking via tablet device (iPad)

10. Cons Heavily reliant on internet connection (although offline marking can be done using mobile app) Additional screen time No ‘blind’ second marking, need to establish system for second markers to annotate papers Symbols, images, cannot be used in feedback Association with Turnitin plagiarism detection Potential for ‘spying’? Moodle tutor/seminar groups need to be set up so that tutors can easily locate just their students’ submissions (from large group) Requires change to previous marking practice

11. Anonymous marking Plan carefully with summative assignments that are being marked anonymously!  If at any time anonymity is turned off (by anyone), it cannot be turned back on again for that assignment!  Plan to accommodate mitigating circumstances extensions and resits (return of grades/feedback removes anonymity)  extend the assignment post date, or  create new assignment(s) for extensions and/or resits

12. Anonymous marking Student should not include their names in assignment titles Think about redesigning assignment templates that ask them to do this Assignments will be re-named automatically once the post date passes There is no bulk de-anonymise process - individual

13. Using an iPad with GradeMark  Offline marking  Need to start the process on your office PC  Turnitin app is free to download  Beware of synchronisation process with multiple markers  Further resources are available in RADAR

14. Choose group of assignments to mark Choose your tutor/seminar group assignments

15. Demonstrate QuickMarks  QuickMark manager  Importing/exporting QuickMark sets

16. Activity 2: Import a QuickMark set; mark an assignment You have been provided with a QuickMark file (exported from a manually created QuickMark set) to import. Import the QuickMark set Select one of the ‘mock students’ Open up their assignment & use the GradeMark functions to give written feedback Discussion: How can course QuickMark sets be updated each semester/year?

17. Demonstrate Rubrics  Rubric manager  Importing/exporting rubrics

18. Activity 3: Create and apply a rubric to an assignment  Select an assignment to mark  Create a new rubric (using your own marking criteria)  Apply the rubric to this assignment  Export the rubric and share it with a colleague  Import your colleague’s rubric

19. Resources  Jisc Electronic Management of Assessment project website at http://ema.jiscinvolve.org/wp/ http://ema.jiscinvolve.org/wp/  Maguire, G. & Pearson, R. (2012) Case Study – Turnitin GradeMark: https://weblearn.ox.ac.uk/access/content/group/f4390f96-516a-4ab0-ac61- 8a963b312453/docs/Turnitin_grademarkv1.pdf https://weblearn.ox.ac.uk/access/content/group/f4390f96-516a-4ab0-ac61- 8a963b312453/docs/Turnitin_grademarkv1.pdf  Oxford Brookes University (2012) What is GradeMark?: https://wiki.brookes.ac.uk/display/BVhelp/GradeMark https://wiki.brookes.ac.uk/display/BVhelp/GradeMark