The ITEAM Project (integrating technology enhanced assessment methods for improved student support and self-regulation) Rolling out institutional technologies – Electronic Voting Systems (EVS) Sharing the lessons from the ITEAM Project: integrating technology enhanced assessment Methods Julie Vuolo and Janet Webber

Background Internally funded Assessment and Feedback project Formulation of Assessment-for-Learning principles Use of EVS to reduce assessment load and encourage active learning and engagement Included provision of 3,845 electronic voting handsets across 8 academic Schools JISC funding provided support for further Assessment and Feedback project Schools purchased own EVS handsets 2012 (2975) Lifecycle – logistics of implementing across an organisation

Decision Phase Consider pedagogical rationale for use Decide implementation approach e.g. Top down Agree type and number of handsets required Identify training needs Ensure technical and administrative support in place

Purchase Phase Identify preferred supplier Agree pricing framework Confirm order-to-delivery times Agree ordering process with procurement teams Identify delivery point Request named contact identified for receipt of goods

Distribution Phase Agree personnel responsible for assigning handsets to students (barcode scanner to EVS database), ensure scanners available, train personnel in use Agree timing of distribution Give essential information* to students at point of distribution (EVS info card & EVS info sheet) Ask Programme Tutors / Module Leaders to signpost students to VLE EVS page using programme and module pages Ensure re-issued handsets have new batteries and are cleaned before distribution * Essential handset information includes what to do if it is lost and an URL for the EVS web page

Usage Phase Teaching / Professional staff know how to use the technology Teachers explain to students how & why EVS is used Students know to bring their handsets to every class Students are reminded that misuse of the handset may be construed as academic misconduct Faulty or lost handsets are replaced using the agreed replacement procedure ** Students know how to replace handset batteries & to recycle old ones Test conditions are employed where appropriate Timing of release of results agreed; errors in reporting identified and rectified promptly Feedback on tests is timely with opportunities to discuss Technical support provided by Help Desk; L&T support provided by Learning and Teaching Institute/Champions

Return Phase A process for return is agreed which includes a specified return point and a return by date Students are informed in advance (e.g. module handbook, , verbally) Module teams re-enforce message The handset is un-assigned from the student at the point of return Batteries are replaced / handset cleaned for re-issue Students who fail to return the handset are recorded as debtors at the discretion of the School A list of student EVS debtors is sent to the Student Centre by the agreed deadline

Success factors Doing the ‘journey’ in advance Identifying key players from pro-VC to goods inward to supplier and manufacturer Take account of organisational developments/changes Keep everyone informed Providing just-in-time support Expect the unexpected, assume nothing