Annual Monitoring & Review THE CRIMEA PILOT Continuous Review for Improvement and the Monitoring of Enhancement Activities Quality Assurance Services

Introductions Who are we? Who are you?

CRIMEA PILOT Aims & Expectations Kick start re-engagement with AMR Rebalance assurance and enhancement Emphasise outputs Reduce burden/ save time Clarify threshold standards/ KPIs Distinguishing Features Freedom within broad parameters More timely implementation of actions Enhanced/ focused data provision ‘Single currency’ course log/ action plan An executive summary HoS engagement

How did we get here? Recommendations of Academic Board after the 13/14 Annual Monitoring and Review Cycle Outcomes of QAA Quality Code Chapter B8 (Monitoring and Review) mapping activities Annual Monitoring & Review Short Life Working Group Ongoing consultation via focus groups/ / online Consistent endorsement of emerging proposals

Outputs What goes up doesn’t come down Does anyone read my report? I have to wait to make changes Too much compliance & not enough enhancement I’ve got action plans coming out of my ears! Process Too prescriptive Too many meetings Imposed schedules Repetitive activities Impenetrable/ unqualified data Unclear performance expectations Students aren’t interested/ engaged What can I do? The problem is with these modules AMR Course Leader Issues

Outputs Keep it brief/ report by exception Report earlier when achievements are fresh in the mind Have the opportunity to discuss actions with HoS Power to introduce timely enhancements Focus on good practice for embedding/ sharing Process Capture current range of activities more effectively More organisational latitude/ autonomy Clarity on performance measures No duplication of discussion/ reporting Better presentation of data with pre-analysis undertaken More timely availability of data Course Leader Aspirations Continuous Improvement

CRIMEA PILOT Key Elements of Process 1.Keep a Course Log linking to evidence 2.Freedom to arrange student engagement 3.Availability of early warning KPI data 4.End of year “Executive Summary” 5.Monitoring role for Head of School who will also lead the discussions on outputs

CRIMEA PILOT Threshold Parameters for Course Log/ Action Planning INTERNAL: Achievement Module evaluation Individual module success measures Student engagement and VLE update each semester L4 to L5 progression (UG) EXTERNAL: External examiner feedback DLHE/ Employability NSS (UG)

CRIMEA PILOT Benefits Less prescription Ability to align activities with course ‘drivers’ Clarity around threshold requirements Empowered to make changes in a timely way Recognition of the importance of the HoS role Focused support for courses

Support for ‘Pilotees’ ed documentation pack after briefings – to include “A Ladybird Book of CRIMEA” Regular engagement with QAS colleagues through your established networks – invite us along Pilot group meetings at key points in the cycle Targeted s when specific data sets/ quality indicators become available A quality indicator/ data calendar Dedicated web support and pilot updates

CRIMEA PILOT What to do first Familiarise yourself with the documentation Alert the rest of the course team Think about the QA and QE activities that could be included in the log and start capturing them now Be prepared to have discussions with admin. colleagues about the best approach to maintaining the log and the evidence Talk to your existing course reps about effective ways to manage student involvement in AMR

Collaborative context Consideration given by SLWG to collaborative context / challenges Multiple intakes/ delivery locations Increased opportunities for comparative analysis of standards Enhanced MI Evidence of liaison between Leeds-based teams and partner- based teams Course and Partner level monitoring Other requirements – MQA, EDB, etc

Role of Link Tutor Dependent on collaborative model – franchise, joint, validated Where is the Course Leader located? Course Leader responsible for completion of course log, oversight rests with Link Tutor Technology a key enabler Discussions in Leeds about issues / resolutions to queries may result in Link Tutor entries ….. University staff at student meeting Revalidation…

Quality indicators ‘Information windows’ Responsibility for provision of information Responsibility for interpreting quality indicators Equivalents – employability data, NSS Series of check points throughout academic cycle Course Leader Summary – section for Link Tutors Opportunity to combine annual Link Tutor report with exec summary …..

Communication to partners Partner Development Day Quality Connections Letter from QAS – Sep 15 via key stakeholders: Franchise/ Collaborative Coordinators, Link Tutors, Admin Course Leader Exec Summary Template- all partners Pilotees new process Non-pilotees – old process QAS engagement with in country bodies

Questions?