PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education and Skills OECD

THE GLOBAL CONTEXT

3 The structure of the PISA assessment Reading Mathematics Science Problem Solving Digital Reading Problem Solving, Financial literacy, Digital Math, Digital reading

Helen the Cyclist Helen has just got a new bike. It has a speedometer which sits on the handlebar. The speedometer can tell Helen the distance she travels and her average speed for a trip. Helen rode 6 km to her aunt’s house. Her speedometer showed that she had averaged 18 km/h for the whole trip. PISA 2012 Sample Question Which one of the following statements is correct? A.It took Helen 20 minutes to get to her aunt’s house. B.It took Helen 30 minutes to get to her aunt’s house. C.It took Helen 3 hours to get to her aunt’s house. D.It is not possible to tell how long it took Helen to get to her aunt’s house.

Percent of 15-year-olds who scored Level 3 or Above PISA 2012 Sample Question

Fig I High mathematics performance Low mathematics performance … Shanghai-China is above this level (613) Mean performance in mathematics – PISA 2012 … 12 countries perform below this line

Low mathematics performance Fig I High mathematics performance Performance and equity: a tradeoff ? High impact of socio-economic condition on student outcomes Low impact of socio-economic condition on outcomes

Percentage of top performers in mathematics in 2003 and 2012 Fig I

What makes schools and school systems successful? 9

Cumulative expenditure per student (6 to 15) and maths performance in PISA 2012 Cumulative expenditure per student below USD Cumulative expenditure per student above USD Fig IV.1.8

11 Align the resources with the challenges Greater equity Less equity Adjusted by per capita GDP Countries with better performance in mathematics tend to allocate educational resources more equitably Source: PISA 2012

12 Adequate resources to address disadvantage Disadvantaged schools reported more teacher shortage Advantaged schools reported more teacher shortage A shortage of qualified teachers is more of concern in disadvantaged schools

Among high-income countries high-performers pay teachers more Per capita GDP less than USD Per capita GDP over USD Fig IV.1.10

Countries that grant schools autonomy over curricula and assessments tend to perform better in mathematics Fig IV.1.15

Schools with more autonomy perform better than schools with less autonomy in systems with more accountability arrangements Score points School autonomy for curriculum and assessment x system's level of posting achievement data publicly Fig IV.1.16

HOW MUCH DO YOU KNOW ABOUT HOW YOUR SCHOOL / DISTRICT COMPARES INTERNATIONALLY?

OECD TEST FOR SCHOOLS (BASED ON PISA)

OECD Test for Schools (based on PISA) Overview Based on international PISA test of 15-year olds. All results are comparable to international PISA scales Can be used by schools, networks of schools and districts Goes beyond testing whether students can reproduce what they were taught to assess students’ capacity to extrapolate from what they know and creatively apply their knowledge in novel situations Provides information on students’ engagement and the learning environment at the school

OECD Test for Schools (based on PISA) What does the assessment look like? Experience for students similar to that of the main PISA tests: 3h 15min Three assessment domains: reading, math, science Student sample size per school: 75 (some schools may test over 100 students) A comprehensive (150 pages) school report for each participating school

OECD Test for Schools (based on PISA) Timeline Pilot 126 schools across US, UK, Canada Roll out 285 schools in the US 2 nd round Open for sign up Global Learning Network Future plans Computer-based delivery New item formats International availability

OECD Test for Schools (based on PISA) School Year Participation 285 schools tested between November 2013 and April 2014, representing: – 27 states – 119 school districts

OECD Test for Schools (based on PISA) School Year Participation 285 schools participated > 20 schools schools 1-9 schools

OECD Test for Schools (based on PISA) School performance Performance on PISA scale Mathematics PISA % above 25 % above 50% above/below 25% below 10% below Schools in the United States Schools in Shanghai-China OECD Test for Schools OECD TFS 2013/14

Socioeconomic status (ESCS) Performance on PISA scale OECD Test for Schools (based on PISA) Performance and socio-economic status Schools that participated in OECD TfS Schools that participated in the US in PISA 2012 Schools above the diagonal line perform better than what would be expected given the socio- economic status of their students Mathematics

OECD Test for Schools (based on PISA) Measuring socio-economic background ESCS is an international measure of students’ socio-economic and cultural status, based on  the parents’ educational level  parents’ occupational status  home possessions including cultural and educational resources

Socioeconomic status (ESCS) % of students eligible for free/reduced lunch prices Schools that participated in OECD TfS OECD Test for Schools (based on PISA) Measures of socio-economic status

Socioeconomic status (ESCS) Performance on PISA scale OECD Test for Schools (based on PISA) Comparison with schools in Mexico Schools that participated in OECD TfS Schools that participated in Mexico in PISA 2012 Mathematics

Socioeconomic status (ESCS) Performance on PISA scale OECD Test for Schools (based on PISA) Comparison with schools in Shanghai-China Schools that participated in OECD TfS Schools that participated in Shanghai-China in PISA 2012 Mathematics

OECD Test for Schools (based on PISA) Timeline Pilot 126 schools across US, UK, Canada Roll out 285 schools in the US 2 nd round Open for sign up Future plans Computer-based delivery New item formats International availability

OECD Test for Schools (based on PISA) International availability Spain:  Pilot study carried out in 2013  Spanish version to be made available to other Spanish-speaking countries. United Kingdom: Available from this school year (2014/15) Growing interest from other countries

UNDERSTANDING YOUR RESULTS FROM THE OECD TEST FOR SCHOOLS

OECD Test for Schools (based on PISA) School report 150 page eBook: 1.Introduction: Understanding Your School’s Results 2.What Students at Your School Know and Can Do in Reading, Mathematics and Science 3.Student Engagement and the Learning Environment at Your School in an International Perspective 4.Your School Compared with Similar Schools in Your Country 5.Your School’s Results in an International Context School name School District State United States How your school compares internationally OECD Test for Schools

Proficiency levels

OECD Test for Schools (based on PISA) Overview of results (from the pilot) What does the same mean mean? 543 and 543 Reading Level 1 and be`low Level 2 Level 3 Level 4 Level 5 Level 6

Six reader profiles

Quality of teacher-student relations

Disciplinary climate and student performancce

Motivation of students to learn science

Instrumental motivation and performance at your school

OECD Test for Schools School Reports

HOW TO PARTICIPATE

OECD Test for Schools (based on PISA) School Year Testing Testing to begin on October 15, 2014 CTB accredited service provider New version of school report eBook: Newest international evidence and comparison data, 42 updated figures School name School District State United States How your school compares internationally OECD Test for Schools

OECD Test for Schools (based on PISA) Sign up ctb.com/OECDTestforSchools

OECD Test for Schools (based on PISA) Implementation Toolit 1.Leading your OECD Test Program 2.Interpreting Your School Results 3.Case Studies 4.Additional Resources

OECD Test for Schools (based on PISA) Leading Your OECD Test Program Communicate the VISION and PURPOSE of the program Practice effective collaboration and coordination between the district office and individual schools Promote trust and safety for participants Provide appropriate time and resources for your team Include teachers in every step Establish the team and assign clear roles and responsibilities Focus on the schedule, as well as student and parent buy-in

OECD Test for Schools (based on PISA) Thank you!