Jack Buckley Commissioner National Center for Education Statistics October 3, 2013

50 U.S. states, the District of Columbia, and the Department of Defense schools participated Results for each state based on approximately 2011 Assessments: NAEP Mathematics and Science at Grade 8 2 – 3,200 students from 50 to 230 schools for mathematics – 2,300 students from 50 to 220 schools for science Overview National Center for Education Statistics: 2011 Linking Study at Grade 8

47 education systems (38 countries and 9 subnational entities) Results for each education system based on no fewer than Nine U.S. states participated 2011 Assessment: TIMSS Mathematics and Science at Grade 8 3 – Alabama, California, Colorado, Connecticut, Florida, Indiana, Massachusetts, Minnesota, and North Carolina – 4,000 students from at least 150 schools Overview National Center for Education Statistics: 2011 Linking Study at Grade 8

47 education systems assessed 8th-graders in TIMSS Overview National Center for Education Statistics: 2011 Linking Study at Grade 8

5 Overview U.S. states that participated in TIMSS 2011 National Center for Education Statistics: 2011 Linking Study at Grade 8

NAEP and TIMSS Programs National Center for Education Statistics: 2011 Linking Study at Grade 8

NAEP and TIMSS Assessments National Center for Education Statistics: 2011 Linking Study at Grade 8

Reported predicted TIMSS scores for the 43 states that participated only in NAEP. Applied three statistical linking methods: o Calibration, o Statistical projection, and o Statistical moderation Selected statistical moderation method, the simplest of the three, in predicting TIMSS scores NAEP-TIMSS Linking Study National Center for Education Statistics: 2011 Linking Study at Grade 8

Accuracy of prediction was evaluated using scores for the nine states that participated in both NAEP and TIMSS. All three methods yielded essentially the same predicted TIMSS results. In predicting TIMSS scores, additional adjustments were made to make NAEP and TIMSS assessed populations more comparable. The differences between actual and predicted TIMSS scores for the nine states were not statistically different, except in two cases in one subject NAEP-TIMSS Linking Study National Center for Education Statistics: 2011 Linking Study at Grade 8

Compared to the TIMSS average of 500, average scores for 11 1 Department of Defense Education Activity (overseas and domestic schools). 36 states were higher 10 states were comparable 6 states were lower National Center for Education Statistics: 2011 Linking Study at Grade 8

Percentages of students reaching Advanced benchmark (≥ 625) 12 Massachusetts has highest U.S state percentage Chinese Taipei, Singapore, and the Republic of Korea have highest education system percentages National Center for Education Statistics: 2011 Linking Study at Grade 8

Percentages of students reaching High benchmark (≥ 550) 13 Massachusetts has highest U.S. state percentage Singapore and the Republic of Korea have highest education system percentages National Center for Education Statistics: 2011 Linking Study at Grade 8

15 1 Department of Defense Education Activity (overseas and domestic schools). 47 states were higher 2 states were comparable 3 states were lower Compared to the TIMSS average of 500, average scores for National Center for Education Statistics: 2011 Linking Study at Grade 8

16 Percentages of students reaching Advanced benchmark (≥ 625) Massachusetts has highest U.S. state percentage Singapore has highest education system percentage National Center for Education Statistics: 2011 Linking Study at Grade 8

Percentages of students reaching High benchmark (≥ 550) Massachusetts and Vermont have highest U.S. state percentages Singapore has highest education system percentage 17 National Center for Education Statistics: 2011 Linking Study at Grade 8

18 Resources Download the following documents: A highlights report to learn about the NAEP-TIMSS linking resultsthe NAEP-TIMSS linking results A paper to understand the methodology applied in linkingthe methodology applied in linking Papers to find how two assessments, NAEP and TIMSS, compare in what is assessed, and how TIMSS items map onto the NAEP assessment frameworkshow two assessments, NAEP and TIMSS, compare in what is assessedhow TIMSS items map onto the NAEP assessment frameworks Frequently Asked Questions National Center for Education Statistics: 2011 Linking Study at Grade 8

19 Photo Credits: © DNY59/iStockphoto # © PhotoAlto/Michele Constantini/Getty Images, Inc. # © Datacraft Co. Ltd./Getty Images, Inc. # For more information Image will be updated