The Relationship between Inspection and School Improvement Scotland and Uganda Martyn Roebuck, University of Glasgow, Scotland

Uganda and Scotland Uganda In 1992 decided to set up an Education Standards Agency (ESA) In 1992 decided to set up an Education Standards Agency (ESA) Process began in 2000, based on Scottish experience Process began in 2000, based on Scottish experienceScotland In 1992 when OFSTED set up in England, HMI in Scotland continued unchanged In 1992 when OFSTED set up in England, HMI in Scotland continued unchanged

Indicators for an Inspectorate Clarity of function, remit, philosophy Clarity of function, remit, philosophy Output, impact and status Output, impact and status Validity, reliability and transparency Validity, reliability and transparency Capability of inspectorate to deliver Capability of inspectorate to deliver Capability of system to respond Capability of system to respond

Quality Initiative in Scotland Identified criteria of effectiveness of schools Identified criteria of effectiveness of schools Shared Indicators with schools and LAs Shared Indicators with schools and LAs Promoted self-evaluation and development / improvement planning by schools Promoted self-evaluation and development / improvement planning by schools Published “How Good is Our School?” 1996 Published “How Good is Our School?” 1996 Accountability across the system defined Accountability across the system defined Capacity building via associate inspection force Capacity building via associate inspection force Published “Journey to Excellence” 2007 incorporating 3rd edition of HGIOS Published “Journey to Excellence” 2007 incorporating 3rd edition of HGIOS

Relevance of Scottish approach to other countries European Union School Self-Evaluation projects European Union School Self-Evaluation projects OECD ethos indicators OECD ethos indicators Bertelsmann Foundation translated HGIOS Bertelsmann Foundation translated HGIOS Hong Kong Quality Assurance System Hong Kong Quality Assurance System New Zealand and many other countries using the 4-point scale (and now OFSTED … !) New Zealand and many other countries using the 4-point scale (and now OFSTED … !)

Issues to address in Uganda (and in other countries) Clarity of function: “everything except inspection”; inappropriate constraints Clarity of function: “everything except inspection”; inappropriate constraints Philosophy: punitive rather than supportive Philosophy: punitive rather than supportive Validity: unclear criteria, non-evaluative reports, unsuitable points for action Validity: unclear criteria, non-evaluative reports, unsuitable points for action Capability of inspectorate: limited manpower, limited finance, low status Capability of inspectorate: limited manpower, limited finance, low status Capability of System: lack of accountability; districts unable to support follow-up Capability of System: lack of accountability; districts unable to support follow-up

Approach Work within existing resources - remove other functions Work within existing resources - remove other functions Make procedures feasible, but focus on evaluation, quality and improvement Make procedures feasible, but focus on evaluation, quality and improvement Develop explicit criteria and QIs Develop explicit criteria and QIs Set up partnerships to share purposes, criteria and procedures Set up partnerships to share purposes, criteria and procedures Incorporate capacity building Incorporate capacity building Try to address accountability at different levels Try to address accountability at different levels

Examples of changes to procedures What are the KEY features to be evaluated? Define a limited range of QIs What are the KEY features to be evaluated? Define a limited range of QIs Make inspection experience positive Make inspection experience positive Identify strengths to build on Identify strengths to build on Identify realistic key points for action Identify realistic key points for action Feedback should assist SIP Feedback should assist SIP Collate evidence for district and national reporting Collate evidence for district and national reporting

What was achieved in 2002? Limited length inspection visits (< 1 day) Limited length inspection visits (< 1 day) School profile which incorporated school analysis of own strengths School profile which incorporated school analysis of own strengths Limited number of QIs ( Management, Learning and Teaching) Limited number of QIs ( Management, Learning and Teaching) Sampling of data within schools Sampling of data within schools Unintended scale of National coverage! Unintended scale of National coverage!

What outcomes? Over 1450 schools ‘inspected’ (primary, secondary and technical) …..! Over 1450 schools ‘inspected’ (primary, secondary and technical) …..! 280 AAs involved 280 AAs involved Identified important new information about quality of practice in schools Identified important new information about quality of practice in schools Universal approval for evidence-based model Universal approval for evidence-based model Universal approval for transparency and supportive approach Universal approval for transparency and supportive approach Districts keen to incorporate features - but how? Districts keen to incorporate features - but how?

Subsequent support for partnerships with Districts Joint working between Masindi District and ESA Joint working between Masindi District and ESA ESA QIs used to support local inspection as part of long term programme funded by LINK for development of SIPs ESA QIs used to support local inspection as part of long term programme funded by LINK for development of SIPs LINK funding of ESA to inspect and monitor Masindi district schools LINK funding of ESA to inspect and monitor Masindi district schools After 6 years in Masindi, LINK extends support and joint working with ESA to cover 4 more of the poorest Uganda districts After 6 years in Masindi, LINK extends support and joint working with ESA to cover 4 more of the poorest Uganda districts Masindi now one of top 5 performing districts Masindi now one of top 5 performing districts

Issues addressed in Uganda Clarity of function: focus on inspection Clarity of function: focus on inspection Philosophy: positive and supportive Philosophy: positive and supportive Validity: explicit criteria, evaluative reports, improved points for action Validity: explicit criteria, evaluative reports, improved points for action Capability of inspectorate: limited finance inhibits work force, status improved Capability of inspectorate: limited finance inhibits work force, status improved Capability of System: still lack of accountability; districts dependent on external funding to support follow-up, but significant initiatives Capability of System: still lack of accountability; districts dependent on external funding to support follow-up, but significant initiatives

Inspection & School Improvement: Scotland and Uganda Two different cultural, financial contexts Two different cultural, financial contexts Partnerships in school improvement between LA/District and Inspectorate Partnerships in school improvement between LA/District and Inspectorate Separate, arm’s length but complementary functions and accountabilities Separate, arm’s length but complementary functions and accountabilities Compatible philosophies, common aims: Compatible philosophies, common aims: to improve schools

Professor Martyn Roebuck