1. Learning Analytics and Assessment Analytics and Feed Forward

2. Introduction » Supporting student development › Feedforward and a longitudinal view › Centralised view of feedback » Using data to inform the tutoring process › Learning analytics › Assessment analytics » Tutor and Student Support » Code of practice for learning analytics » Questions Technology to support 21 st century tutoring2

3. Longitudinal development: feeding forward 3 » Feed forward and ipsative approaches » Technology enhancements: › Using tools to analyse the timing of assessments › Developing tools to analyse and audit feedback › Creating conditions for student/staff dialogue › Storage of feedback across a programme CC BY-NC-ND 2.0 Waveneyavenue Technology to support 21 st century tutoring

4. Feedback is….. “Staff have found the dialogue with students energising and the acknowledgement that students are learning from the feedback satisfying. Tutors have also learned from students’ comments in the dialogue – demonstrating reciprocal learning” Technology to support 21 st century tutoring4 A conversation http://www.flickr.com/photos/khalidalbaih/5653817859

5. Feedback is… » University of Edinburgh - aimed to view students experience as a 4 years long journey, n ot as one year repeated 4 times » Consisted of › Reflective online templates to support one-to-one meetings › Reflection prompting activities for group meetings Effective Learning Analytics 28/01/155 A conversation » Benefits › Enables the University to monitor students confidence around the Graduate Attribute statements › Tutors finding it useful in preparing for meetings and having more productive meetings › Tutees finding it useful to help collect their thoughts

6. Centralised view of feedback » A longitudinal and holistic approach to student development requires that past feedback is stored and accessible to staff and students » New developments › Moodle Assessment and Reporting Tool › Flourish tool » Emerging discussion through the Jisc Electronic Management of Assessment Project Technology to support 21 st century tutoring6

7. Using data to inform the tutoring process

8. Effective Learning Analytics Priority 1: Basic learning analytics solution, an interventions tool and a student Priority 2: Code of practice for learning analytics Priority 3: Learning analytics support and networks Effective Learning Analytics Network Meeting 20/02/158 Priority Areas for projects

9. Learning Analytics Prediction Tools – analysis of learning activity Technology to support 21 st century tutoring9 Image: BME Solutions LtdBME Solutions Ltd » Use data from student activity to provide actionable insights to predict potential outcomes. » Data sources – e.g. VLE, SRS, attendance, resource use, etc. » Range of approaches from simple bespoke spreadsheets to products based on VLEs, SIS and business intelligence packages. » Supporting retention, attainment, modules choices, employability, etc. » Early stage of development – many tracking rather than analysis. http://analytics.jiscinvolve.org/wp/

10. Assessment analytics » Explored implications of using assessment data to support student development » Demonstrated that sharing the analytics offered something substantially different than for individual feedback alone » And…had a positive impact on motivation » But…needs careful supporting Effective Learning Analytics 28/01/1510 University of Huddersfield ‘…provided some compelling evidence to suggest that engaging with assessment analytics can support student learning by increasing their motivation to act on their feedback whilst also focusing their attention strategically on aspects of their feedback they might otherwise neglect’ EBEAM final report, p. 76 http://repository.jisc.ac.uk/5331/

11. Basic Learning Analytics Effective Learning Analytics Network Meeting 20/02/1511

12. Tutor and Student Support

13. Shared approach to tutoring » TQFE-Tutor – a shared communication and tutoring system developed by the University of Dundee › Comprising blog, email and twitter accounts › Shared record of communications around assignments and feedback › Enabling informed discussions around students longitudinal development Technology to support 21 st century tutoring13 Gaining efficiencies and enhancements » Benefits › Enhanced resilience › Staff development › Time savings › Improved student performance – Pass rate increased from 85% to 96% http://blog.dundee.ac.uk/effect/

14. Intervention Management Tools – supporting tutors Technology to support 21 st century tutoring14 » Managing actionable insights form learning analytics tools. » Collating and sharing good practice. » Example › Co-Tutor™ - Loughborough University. › Aimed at personal tutors › Collates data on student activity. › Tracks tutor interactions with students. http://www.co-tutor.co.uk/

15. Student Success Planner Technology to support 21 st century tutoring15 » An open source tool from Unicon Ltd and Marist College » Features include › Alerts and intervention management › Student Indicators › Intervention Indicators http://www.studentsuccessplan.org/

16. Student App Effective Learning Analytics Network Meeting 20/02/1516 Use cases Measuring engagement Measuring assessment performance Module choice Consent Use cases Measuring engagement Measuring assessment performance Module choice Consent management

17. Student app for learning analytics Technology to support 21 st century tutoring17  My assessments  My engagement  My reading lists  Check-in to event  Find a study buddy  Extra events  How am I feeling?  My consent http://analytics.jiscinvolve.org/wp/2015/04/29/ what-do-students-want-from-a-learning- analytics-app/

18. Code of Practice for Learning Analytics – for institutions, learners, vendors. Technology to support 21 st century tutoring18 A policy, for institutions to adopt/adapt with fact sheets covering following areas » Responsibility – allocating responsibility for the data and processes of learning analytics within an institution » Privacy – ensuring individual rights are protected and data protection legislation is complied with » Validity – making sure algorithms, metrics and processes are valid » Access – giving students access to their data and analytics » Enabling positive interventions – handling interventions based on analytics appropriately » Minimising adverse impacts – avoiding the various pitfalls that can arise » Stewardship of data – handling data appropriately

19. Code of Practice for Learning Analytics – for institutions, learners, vendors. Technology to support 21 st century tutoring19 http://www.jisc.ac.uk/guides/code -of-practice-for-learning-analytics Available June 2015

20. Questions or Activity Effective Learning Analytics 28/01/1520

21. Contacts Contacts: Paul Bailey paul.bailey@jisc.ac.ukpaul.bailey@jisc.ac.uk Lisa Gray lisa.gray@jisc.ac.uklisa.gray@jisc.ac.uk Assessment Management blog http://ema.jiscinvolve.org Assessment resources http://bit.ly/jisc-assess Learner Analytics Blog http://analytics.jiscinvolve.org Technology to support 21 st century tutoring21