Presentation is loading. Please wait.

Presentation is loading. Please wait.

Peer review with Aropa in Computing Science Dr Simon Rogers

Similar presentations

Presentation on theme: "Peer review with Aropa in Computing Science Dr Simon Rogers"— Presentation transcript:

1 Peer review with Aropa in Computing Science Dr Simon Rogers

2 The course: PSI Professional Skills and Issues: – L4 and Msc students (>100) – Compulsory: Required for BCS accreditation – Non-technical: Ethics, IPR, Data protection etc – Not the most popular L4 course…… Assignment: – 1,500 word essay. – 2 stage peer review process. – Final mark (from academic) weighted by `engagement factor

3 Aropä Peer review management software developed by John Hamer (Auckland & SCS) and Helen Purchase (SCS). – – Handles everything: – Submission (word/pdf, txt) – Assignment to reviews – Review rubric (design your own) – Returning reviews to reviewers – Reviewing of reviews Very easy to use. Local support available. – Willing to expand system to meet new requirements.

4 Peer review process 1.Trial exercise 1.500 word essay 2.2 reviews 3.Not assessed (almost 100% response) 2.Assessed exercise 1.Students submit draft essay on one of 3 topics (0.7). 2.Assigned 3 reviewers from same topic. 3.Reviewers assess work (numerical ratings and text justification) (0.05 x 3). 4.Reviews returned to authors who can use them to improve essay. 5.Each student also reviews 3 other reviews (0.05 x 3). 6.Final marking done by academics, weighted by factors (X)

5 Pros & Cons Pros: – Aropa very easy to use – assigning reviews, handling deadlines, monitoring submissions etc. – High level of engagement (almost all students completed everything). – Massive quantity of feedback (not always high quality) Cons: – Between cohort tension (L4 v MsC). – `Threat of plagiarism (by reviewers). – Lack of peer review experience – poor quality of feedback (first use of peer review for 85% of class). – Anonymity (.doc files).

6 Other feedback Only 20% of students would have been happy to be formally assessed by peers. Of those who thought the exercise improved their essay (42%!), 71% felt that the most helpful bit was receiving feedback.

Download ppt "Peer review with Aropa in Computing Science Dr Simon Rogers"

Similar presentations

Ads by Google