1. Lisa Gray and Paul Bailey Technology to support 21 st century tutoring

2. Introduction » Supporting student development › Feedforward and a longitudinal view › Centralised view of feedback » Using data to inform the tutoring process › Learning analytics › Assessment analytics » Tutor support » Code of practice for learning analytics Technology to support 21 st century tutoring 2

3. Supporting student development

4. Longitudinal view of student development 4 » Feed forward and ipsative approaches » Technology enhancements: › Using tools to analyse the timing of assessments › Developing tools to analyse and audit feedback › Creating conditions for student/staff dialogue › Storage of feedback across a programme CC BY-NC-ND 2.0 Waveneyavenue Technology to support 21 st century tutoring

5. Feedback is….. “Staff have found the dialogue with students energising and the acknowledgement that students are learning from the feedback satisfying. Tutors have also learned from students’ comments in the dialogue – demonstrating reciprocal learning” Technology to support 21 st century tutoring 5 A conversation http://www.flickr.com/photos/khalidalbaih/5653817859

6. Feedback is… » The ‘Unfold’ project at the University of Edinburgh promotes the view of the students’ experience as a 4 years long journey, n ot as one year repeated 4 times » Consisted of › Reflective online templates to support one-to-one meetings › Reflection prompting activities for group meetings Effective Learning Analytics 28/01/15 6 A conversation » Benefits › Enables the University to monitor students confidence around the Graduate Attribute statements › Tutors finding it useful in preparing for meetings and having more productive meetings › Tutees finding it useful to help collect their thoughts

7. Centralised view of feedback » A longitudinal and holistic approach to student development requires that past feedback is stored and accessible to staff and students » New developments › Moodle Assessment and Reporting Tool › Flourish tool » Emerging discussion through the Jisc Electronic Management of Assessment Project Technology to support 21 st century tutoring 7

8. Using data to inform the tutoring process

9. Learning Analytics Prediction Tools – analysis of learning activity Technology to support 21 st century tutoring 9 Image: BME Solutions LtdBME Solutions Ltd » Use data from student activity to provide actionable insights to predict potential outcomes. » Data sources – e.g. VLE, SRS, attendance, resource use, etc. » Range of approaches from simple bespoke spreadsheets to products based on VLEs, SIS and business intelligence packages. » Supporting retention, attainment, modules choices, employability, etc. » Early stage of development – many tracking rather than analysis. http://analytics.jiscinvolve.org/wp/

10. Assessment analytics » Explored implications of using assessment data to support student development » Demonstrated that sharing the analytics offered students something substantially different than they got from individual feedback alone » And…had a positive impact on motivation » But…needs careful supporting Effective Learning Analytics 28/01/15 10 University of Huddersfield ‘…provided some compelling evidence to suggest that engaging with assessment analytics can support student learning by increasing their motivation to act on their feedback whilst also focusing their attention strategically on aspects of their feedback they might otherwise neglect’ EBEAM final report, p. 76 http://repository.jisc.ac.uk/5331/

11. Tutor support

12. Shared approach to tutoring » TQFE-Tutor – a shared communication and tutoring system developed by the University of Dundee › Comprising blog, email and twitter accounts › Shared record of communications around assignments and feedback › Enabling informed discussions around students longitudinal development Technology to support 21 st century tutoring 12 Gaining efficiencies and enhancements » Benefits › Enhanced resilience › Staff development › Reduced isolation › Time savings › Improved student performance – Pass rate increased from 85% to 96% http://blog.dundee.ac.uk/effect/

13. Intervention Management Tools – supporting tutors Technology to support 21 st century tutoring 13 » Managing actionable insights form learning analytics tools. » Collating and sharing good practice. » Example › Co-Tutor™ - Loughborough University. › Aimed at personal tutors › Collates data on student activity. › Tracks tutor interactions with students. http://www.co-tutor.co.uk/

14. Student apps for learning analytics – completing the loop Technology to support 21 st century tutoring 14 http://www.unisocs.co.uk/ » Push - Presenting data and predictions from learning analytics tools to students, sharing similar information to what the tutor sees. » Transparency vs risks of “alarming” predictions. » Pull - Collecting learner data to enrich the prediction model. » Example: Unisocs – Personal Student Dashboard › Recent activity › Module Progress › Module Activity › Relies on the student entering data

15. Code of Practice for Learning Analytics – for institutions, learners, vendors. Technology to support 21 st century tutoring 15 A 2-4 page policy, for institutions to adopt/adapt with fact sheets covering following areas (available June 2015) » Institutional approach » Awareness and consent » Transparency around algorithms and metrics » Ownership and control of data » Using publicly available data » Accuracy of data » Considering personal circumstances » Respecting privacy » Opting out » Interpretation of data » Stewardship, preservation and deletion of data » Interventions and the “obligation to act” » Impacts on student behaviour » Targeting resources appropriately » Anonymisation » Taking data outside the institution » Staff awareness and training http://repository.jisc.ac.uk/5661/1/Learning_Analytics_A-_Literature_Review.pdf

16. Contacts Contacts: Paul Bailey paul.bailey@jisc.ac.ukpaul.bailey@jisc.ac.uk Lisa Gray lisa.gray@jisc.ac.uklisa.gray@jisc.ac.uk Assessment Management blog http://ema.jiscinvolve.org Assessment resources http://bit.ly/jisc-assess Learner Analytics Blog http://analytics.jiscinvolve.org Technology to support 21 st century tutoring 16