1. Implementing a mobile e-Portfolio system – Lessons learned a year on Luke Woodham, Fiona Howat, Jonathan Round, Terry Poulton, St. George’s, University of London

2. WPBAs at SGUL Year 1Year 2Year 3 Year 4Year 5 Basic Science Transition Pre-Clinical Practice Foundation MBBS5 Year 1 Transitional (T) Year MBBS5 Year 2 MBBS4 Year 1 Penultimate (P) Year Final (F) Year Workplace-based assessments (WPBAs) Key element in both learning (formative) and summative assessment of clinical competency

3. Complex, hard to read Difficult to analyse – No validation – “spoilt” assessments – Illegible Large number of forms to manage – Lost and damaged forms – Difficulties in storage Submission difficulties when off-site Difficult for students to monitor progress Paper WPBAs

4. E-Portfolio – Aims Key Aims – Students should “own” their own data - provide learners with real-time access to their progress – Improving feedback to students – Reduced administration load

5. e-Portfolio - ‘state of the art’ issues Mature web-based systems for desktop data entry, were available, but heavily criticised: Why? Student/clinician encounters don’t take place at a computer The responsibility for completing assessments lies with the student not the teacher Potential solution? - a mobile solution that does not require network access - wifi is not reliably available.

6. MyProgress Web-based – Hosted solution – Commercially developed by MyKnowledgeMap – All data stored centrally Allows data input from both the web and mobile devices – Cross-platform Works offline – Downloads new assessments for use offline – Uploads completed assessments back to system www.myknowledgemap.com

7. 2013-14 - Pilots Series of pilots – Medicine and Radiography – Iterative improvements based upon feedback – Expanding scope Multiple attachments and sites, increased participant numbers Feedback – Improved feedback from using tablets rather than phones – Increase in number of assessments completed – or at least submitted

8. 2014-15 Academic Year Year 3 Year 4Year 5 Transition Pre-Clinical Practice Transitional (T) Year Penultimate (P) Year Final (F) Year Following a series of pilots to establish feasibility, introduced Myprogress for completion of WPBAs – Gradual rollout in Medicine – Also used in Diagnostic Radiography, Co-curricular award, and next year in Therapeutic Radiography Electronic WPBAs Paper WPBAs 2014-15 Electronic WPBAsPaper WPBAs 2015-16 Electronic WPBAs 2016-17

9. Technical Setup Students provided with 7” Android tablets Set up with institutional account for installing Myprogress Students able to use for other aspects of studies

10. An opportunity for WPBA is identified The student begins to enter assessment details onto their mobile device The device is passed to the assessor The assessor completes and locks the assessment and hands the device back to the student who then submits the assessment when they next have network access

11. Key Lesson - Students need to “own” their portfolio How can students be encouraged to feel they “own” their portfolio? – If students have responsibility, they need to have power to ensure all their WPBAs are complete

12. WPBA sent RESPONSIBILITY POWER Academic Registry Standard WPBAs Completed WPBA

13. If students have responsibility, they need to have power to ensure all their WPBAs are complete Unfortunately, in one aspect, we broke this rule.

14. Signoff returned RESPONSIBILITY POWER Clinical sign-off Signoff sent Face-to-Face Meeting Academic Registry

15. Current and Future challenges Engaging with clinical tutors – Communication and training Support – Technical challenges – How to effectively support multiple courses and sites Changing the culture – Ensuring students “own” their own portfolio – Increasing acceptance amongst clinical staff opportunities!

16. Thank you and Questions lwoodham@sgul.ac.uk www.elu.sgul.ac.uk