1. November 2013 How inspectors use data before and during school inspections in England Chris Wood Her Majesty’s Inspector

2. Add presentation title to master slide | 2 Inspectors use a range of data before and during the inspection  RAISEonline  Sixth Form PANDA  Parent View  The School Data Dashboard (with governors)  Optional questionnaire for staff  Similar products exist for Further Education & Skills: e.g. Learner View  New and innovative products are being developed all the time: e.g. Data View; forthcoming dashboards for Special Schools and Further Education & Skills providers

3. RAISEonline

4. Add presentation title to master slide | 4 RAISEonline is prominent data tool for schools and inspectors…it is a starting point for self evaluation and inspection  RAISEonline is an on-line data tool that was introduced in 2006.  Ofsted is responsible for the system but uses a private company to help with its day to day running; Pupil data is provided by the Department for Education but Ofsted calculates all of the indicators.  It provides a common set of analyses for schools, local authorities, governors and inspectors.  Schools make considerable use of ROL when completing self-evaluation. They also have access to interactive and pupil level data.  Inspectors make considerable use of ROL prior to and during inspections.  Ofsted are building a new system which will allow much more data to be made available to the public; it aims to get this data released as close to the start of the school term as possible.

5. Add presentation title to master slide | 5 RAISEonline provides schools and inspectors with comprehensive information at cohort, group and pupil level:  A school’s contextual information (compared to other schools nationally)  Census ward information (where pupils live)  Ethnic groups and English as an additional language  Absence and exclusions  Pupils’ prior attainment  Pupils’ end of key stage attainment (age 7, 11 or 16)  Attainment in different subjects  Value added and expected progress measures  Narrowing the gap with the Pupil Premium

6. Add presentation title to master slide | 6 The big picture: inspectors can quickly see what type of school it is and how it compares with typical schools nationally… Size Gender Free School Meals Ethnicity Language SEN Pupil movement Deprivation e.g. This school has lower than average proportions of disadvantaged pupils but higher proportions at School Action + and with a statement of educational needs – something to explore?

7. Add presentation title to master slide | 7 Inspectors can see how trends in the attendance of pupils at the school compares with the national picture overall…. Attendance feeds into the judgement on ‘behaviour and safety’ Data is provided for overall levels of absence and for proportions of pupils who miss school regularly

8. Add presentation title to master slide | 8 …but also at group level…so that any differences within the school or against the national picture can be identified Similar detailed information is available for fixed term and permanent exclusions

9. Add presentation title to master slide | 9 Benchmark attainment data over time allows inspectors to see school trends and compare with changes at the national level One school has improved …but at a slower rate than other schools nationally Students' attainment is now much lower than average in the other school These are important trails…

10. Add presentation title to master slide | 10 Inspectors can also dig deeper into trends or variations in average points attainment for core subjects…

11. Add presentation title to master slide | 11 …and to compare the attainment of different groups of pupils in key areas Attainment in maths looks weaker than in English – what has the school done about this? What impact have they had? Most groups in English appear to perform at a level similar to the average - but middle ability pupils seem to do particularly well. Why is this? Are there lessons to be learnt? Has this been maintained?

12. Add presentation title to master slide | 12 Inspectors can see how much value the school adds to pupils in different subject by the time they reach the end of a key stage - here at KS4 VA in English, maths and humanities looks very broadly average but is weaker in science and languages. Does this link to the quality of teaching in those subjects or are there issues with the curriculum? Why does science look weak?

13. Add presentation title to master slide | 13 And how much value the school adds to different groups of pupils, compared to similar pupils and all pupils nationally Inspectors take particular care when interpreting data about small groups. This can be a particular issue in small primary schools.

14. Add presentation title to master slide | 14 Pupils are expected to make two levels of progress between KS1 and KS2… The progress tables provide information on whole level and sub level progress They are available for English and mathematics At KS2 there are also separate tables for reading and writing Here all pupils at 2A made expected progress but only one made more than expected progress…

15. Add presentation title to master slide | 15 …and three levels between KS2 and KS4 Inspectors look closely at the proportion making and achieving more than expected progress They use this information to form hypotheses about the typical rates of progress made by pupils of different abilities…this can then be tested out further during the inspection

16. Add presentation title to master slide | 16 Inspectors also use the data to see how well the school is narrowing the achievement gap between disadvantaged pupils and their better off peers

17. Add presentation title to master slide | 17 Recent additions to the data available to inspectors includes the Year 1 phonics screening check The phonics screening check is an assessment to confirm whether children have learnt phonic decoding to an appropriate standard. It is for all Year 1 pupils in maintained schools, academies and Free Schools. It is a statutory requirement for all schools to carry out the screening check.

18. The Sixth Form PANDA

19. Add presentation title to master slide | 19 The sixth form performance and assessment report (PANDA) supports the inspection of school sixth forms and aids school self-evaluation  Two types of PANDA Report are planned for the 12/13 academic year – one containing unvalidated data in early December and the other in April containing validated data.  The PANDA includes:  Contextual information based on the number of students on roll submitted to the Department for Education (DfE) in the January school census.  Information about the attainment of students in the sixth form, who took a Level 3 qualification, compared with the national average (qualification, subject, gender and ethnicity.)  A prior attainment chart and three year trend data for A levels and AS levels are included.  A summary of the Level 3 Value Added (L3VA) data prepared by the DfE.

20. Add presentation title to master slide | 20 Inspectors can review data about overall attainment (A-E) and at the higher grades (A*-B)

21. Add presentation title to master slide | 21 And look at the value added to students studying different Level 3 qualifications  Duplicate Inspectors consider other data provided by the school, including commercially produced packages e.g. Alps, ALIS (see slide 28)

22. Parent View

23. Add presentation title to master slide | 23 Parent View is an on-line questionnaire for parents to express their views about their child’s school  Launched in 2011, it covers over 22,000 schools across England.  The questions were chosen to cover issues that parents told Ofsted are the most important to them.  The results provide Ofsted with the information to support decisions about inspection and give headteachers a direct route into gathering the views of their parent group.  A balance of measures, including a registration process with password, are in place to ensure the security of the website and to treat schools fairly, while making sure it is accessible.  The results for each school are published on the website in real time. They are saved at the end of the academic year so that every school will have an on-going year-on- year picture available to view.  Inspectors look at this information before and during an inspection. They also consider any other surveys of parental views that a school has carried out.

24. Add presentation title to master slide | 24 Parents give their view on 12 questions, from strongly agree through to strongly disagree:  My child is happy at this school  My child feels safe at this school  My child makes good progress at this school  My child is well looked after at this school  My child is taught well at this school  My child receives appropriate homework for their age  This school ensures the pupils are well behaved  This school deals effectively with bullying  This school is well led and managed  This school responds well to any concern I raise  I receive valuable information from the school about my child’s progress  I would recommend this school to another parent www.parentview.ofsted.gov.uk

25. Add presentation title to master slide | 25 Parents can access results for any school not just the one where their children go  My child is taught well at this school:  Strongly agree : 52%  Agree : 43%  Disagree : 3%  Strongly disagree : 1%  Don't know: 2%

26. Triangulating data during the inspection

27. Add presentation title to master slide | 27 Inspectors use data to identify inspection trails and plan an inspection strategy…they then look at what is currently happening in the school  Inspectors consider the extent to which the historic and current performance of the school match  There is a major focus on lesson observations to evaluate the quality of teaching and its impact on learning and progress  Inspectors also look at:  the school’s own monitoring information about the ‘typical’ quality of teaching  The school’s own tracking and analysis of the achievement of pupils currently in the school  The most up-to-date data on attendance and persistent absence  The schools own information about behaviour, including exclusions  Any analysis that the school has from its own surveys of parents, pupils, or staff

28. Add presentation title to master slide | 28 Inspectors also have to be familiar with a wide range of mostly commercial products…schools use a range of data to evaluate their performance  CATs - Cognitive Abilities Test – a suite of standardised tests that measures the three principle areas of reasoning – verbal, non-verbal and quantitative - and indicate future achievement  Fischer Family Trust - FFT is a non-profit company established in 2001. FFT provide data and analyses to a schools and LAs in England and Wales. Estimates are used to inform target setting.  ALPS - A Level Performance System - provides A level, AS level and BTEC Level 3 value added reports.  MidYIS - Middle Years Information System – baseline tests for Years 7, 8 and 9  YELLIS - Year 11 Information System - is a value-added monitoring system that provides a wide range of performance indicators and attitudinal measures for students in the last two years of schooling  ALIS – Advanced Level Information System - provides performance indicators for Post-16 students across all sectors of education, both in the UK and Internationally.

29. The School Data Dashboard

30. Add presentation title to master slide | 30 The School Data Dashboard provides governors with a snapshot of their school’s performance…it is available to the public.  Launched in February 2013, the dashboard can be used by school governors and by members of the public to check the performance of the school in which they are interested.  The School Data Dashboard complements the Ofsted school inspection report by providing an analysis of school performance over a three-year period.  Inspectors will routinely discuss with governors the extent to which they are aware of and make use of this information to monitor the school’s performance and hold leaders to account  Data covers:  Expected progress  Attainment  Attendance  Closing the gap between disadvantaged and other pupils http://dashboard.ofsted.gov.uk

31. Add presentation title to master slide | 31 The dashboard compares the attainment of pupils in different subjects with similar schools and all schools nationally

32. Add presentation title to master slide | 32 It also compares the progress made by pupils over time and provides information about the progress of disadvantaged pupils

33. Add presentation title to master slide | 33 It also gives a clear indication of how attendance in a school compares with all others nationally The school is in the fourth quintile for attendance. Over the last three years attendance has been very close the national average for all schools.

34. Additional slides

35. Add presentation title to master slide | 35 Data View is a digital tool enabling people to compare regional and local performance of schools, further education, social care and childcare providers  The tool allows you to compare and contrast performance in Ofsted inspections in regions, local authority areas and constituencies over a number of years. For example:  to see whether schools in one area are getting better over time and whether they are doing as well as schools in similar areas in other parts of the England.  to compare how well primary aged pupils who go to school in the most disadvantaged areas achieve across different regions of the country  Data View also enables the comparison of similar local authority areas.  http://www.ofsted.gov.uk/resources/statistics/data-view http://www.ofsted.gov.uk/resources/statistics/data-view

36. Add presentation title to master slide | 36 Learner View is an online questionnaire that gives learners the chance to tell Ofsted what they think about their further education and skills provider  Learner View asks learners for their opinion on a range of 10 aspects: from whether the lessons/training sessions are well taught to if they would recommend the provider to a friend.  Ofsted use the information when making decisions about which providers to inspect, and when.  Learners are able to see what other learners have said about their provider or view the results for other further education and skills providers in England.  http://learnerview.ofsted.gov.uk http://learnerview.ofsted.gov.uk