1. TouchStone Dr Simon Wilkinson Medical Education Unit University of Nottingham Medical School ‘ a local system for local people ’

2. TouchStone Assessment Management System –Computer-Based Assessments –Offline assessment support –Surveys/Questionnaires Development started 2002 Licensed to University of Sheffield 2003 QABME 2009 – innovation/good practice “Touchstone as a resource for blueprinting, standard setting, receiving external examiners’ comments on examination questions, performing post examination analysis and especially the potential to provide detailed feedback on examination performance to students.”

3. Why? Assessment Are students fit for purpose (GMC) Quality Assurance Are assessments fit for purpose –Peer/External Examiners –Blueprinting –Post-exam item analysis Enhanced Annual Review (EAR) Purpose

4. How? Reduce Costs Reducing time – supporting process in software Peer/External examiner review Standards Setting Blueprinting Item Analysis Purpose Process

5. Who? Purpose People Staff – Academic Staff – Administrative Staff – Technical Students Process People

6. Result Purpose Process People Performance

7. e-Assessment – Lifecycle Pre- Exam Mid- Exam Post- Exam Question writing Blueprinting Internal peer review External Examiner review Standards Setting Questions presented Answers recorded Analysis of performance Fix incorrect answers Exclude poor questions Export marks Personalised student feedback Refine Items

8. External Examiner Comments UoN Requirement – external examiners given access to assessments

9. Standards Setting – Ebel GMC Requirement – all knowledge exams standard set

10. Learning Objectives – the ‘glue’ VLE Networked Learning Environment e-Assessment TouchStone e-Portfolio Insight Learning Objectives Personal reflection Progression/Certification e-Teaching/e-Learning

11. Blueprinting - sampling GMC Requirement – all knowledge exams blueprinted

12. Individual student feedback

13. Item Analysis – Question Exclusion Good practice – educational literature

14. Performance – Academic Purpose Process People Blueprinting Sampling Individual Feedback Media-rich assessments Widening learning objectives tested Assess higher levels of cognitive engagement Electronic-only question possibilities Drag and drop labelling Image Hotspots Videos Widening learning styles & objectives tested

15. Performance – Economic Purpose Process People Staff - Academic paper reviews (peer & external examiners) standards setting – creates pass mark automatically blueprinting – learning objective sampling track-changes (automatic) archiving (automatic) Staff - Administrative Paper printing time/costs Marking/scanning time Timetabling/room booking

16. Performance – Economic Purpose Process People Students 24/7 access to formative assessments Personalised feedback on exams Personal accessibility settings (where needed)

17. Performance – Economics Purpose Process People JISC 2008: “Assuming the student body in these areas [health and business studies] sat one e-assessed exam per year this alone would represent a cost saving of c. £7 million in staff time.”