How do the risks of a web-based CAA system differ from those of a closed network system? Chris Ricketts University of Plymouth & Stan Zakrzewski London Metropolitan University

Overview l Two different universities l Transferring an approach to a different university l Differences in ‘hardware’ systems l Differences in ‘software’ systems l Did it work? l Discussion (plenty,I hope!)

Two different universities Luton l closed network l on-line exams l large open-access IT suite Plymouth l multi-site so web-based l on-line exams, coursework, formative assessment l large number of smaller IT rooms

Transferring an approach to a different university l Different IT systems l Different approaches to assessment l University-level demand But… ….risk assessment still the key to success l Identify risks l Quantify impact l Plan for the worst case

Differences in ‘hardware’ systems Partly IT systems l Network resilience l Operating systems Also ‘hard-wired’ things l Two semesters l Types of assessment l IT facilities for on-line testing

Differences in ‘software’ systems Partly IT systems l Software l Interfaces Also ‘soft’ things – culture, practices l Invigilators l Exam / coursework balance

Did it work? Identify risks l Some not considered important l Some new risks identified Estimate impact l Some much lower impact l Some greater impact Plan for worst case l Dependent on ‘hard’ and ‘soft’ systems

Did it work? Identify risks l Some not considered important l Some new risks identified Estimate impact l Some much lower impact l Some greater impact Plan for worst case l Dependent on ‘hard’ and ‘soft’ systems

What sort of risks? l Authentication of login across internet not secure l Different authentication between on-campus and off-campus (web-based) use not recognized l External Examiner unable to access exam across web l Students accessing inappropriate materials (eg, web-based) during assessment l Students using different technical platforms (between sites, at home, Mac’s?) l Students using different browsers l Network load too high -L-M-L-L-M-M-M-L-M-L-L-M-M-M

What contingency plan? l Authentication of login across internet not secure l Different authentication between on-campus and off-campus (web-based) use not recognized l External Examiner unable to access exam across web l Students accessing inappropriate materials (eg, web-based) during assessment l Students using different technical platforms (between sites, at home, Mac’s?) l Students using different browsers l Network load too high

Discussion l (plenty,I hope!)