NAEP Program International Assessments District Assessment Coordinator Annual Meeting September 7, 2011 Michele Sonnenfeld

Race to the Top - NAEP Florida’s Key Goal #3 Increase the percentage of students scoring at or above proficient on NAEP by 2015, to or beyond the performance levels of the highest-performing states. Florida aims to go beyond setting goals for moving students to basic levels on NAEP, focusing on moving more students to proficiency and advanced levels. 2

NAEP Program 3 NAEP, LTT, AND PISA Schools find out if they have been chosen Complete and submit School Info Forms Calls to Submit PAV Begin PAV Packets Arrive at Schools PAV visits Begin Assessment Window Age 13 LTT 5/1/2011ASAP8/29/2011 Depends on when Schools or DACs furnish student list so the school can be sampled 9/6/ /10/ /16/2011 Age 9 LTT 5/1/20119/16/201112/5/20111/3/201212/12/20111/9/2012-3/ Gr. 4 and 12 NAEP 5/1/20119/30/20111/16/20111/3/20121/5/20121/23/2012-2/24/2012 Age 17 LTT 5/1/20111/28/20111/30/20122/4/20122/6/20123/19/2012-5/25/2012 Pre-pilot of Technology and Engineering Literacy (TEL) Tasks PISA – Age 15 (born between July 1, 1996 and June 31, 1997) National Dates: Receive Student Listing Form Calls to set PAV Visits Begin PAV Visits beginAssessment Window Sate Mailing 9/26/20118/15/20128/27/20129/4/2012   10/1/ /9/2012 District-Mailing 10/15/11 School Mailing wave 1 10/7/2011 School wave 1 first contact10/22/2011

NAEP 2011 Results October 2011 – Reading and Mathematics, grades 4 and 8 November 2011 – Reading and Mathematics, grades 4 and 8, Miami- Dade and Hillsborough County Public Schools Spring 2012 – Science, grade 8, State and District-level results 4

Inclusion on NAEP 5 National Assessment Governing Board (NAGB) issued a Policy Statement on NAEP Testing and Reporting on SD and ELL on March 6, 2010 Policy intended to maximize student participation, minimize potential for bias, promote fair comparisons between states, and maintain trends Lori Rodriguez, Bureau Chief, Student Achievement Through Language Acquisition; and Karen Denbroeder, Senior Educational Program Director of the office of Program Accountability, Assessment & Data Systems, Exceptional Education and Student Services, assisted with encouraging including more students to be included in NAEP

New Inclusion Guidelines for NAEP Proportion of all students excluded from NAEP sample should not exceed 5% 85% of students classified as either ELL or SD must be included in the NAEP 6

ELL and SD Participation in NAEP Allows SD and ELLs to experience a large-scale assessment administration w/o high-stakes consequences SD and ELLs are provided with accommodations so they can demonstrate their content knowledge and skills on NAEP NAEP does not allow the use of a word- to-word dictionary on NAEP Reading 7

Pre-Pilot of Technology and Engineering Literacy (TEL) Tasks 8 Will take approximately 90 minutes to complete 30 students per school Two sessions of 15 students per school Last 2 weeks in March (March 19 – March 30, 2012) Students will take 2-3 scenario-based tasks on a computer provided by NAEP Tasks are designed to be 10, 20, or 30 minutes long Approximately 10 schools in Florida will be selected to participate

Technology and Engineering Literacy Framework for the 2014 NAEP The assessment targets are organized into three major areas of technology and engineering literacy, each corresponding to a broad body of knowledge and skills with which students should be familiar 9

Best Practices Guides Will be provided to the 24 schools participating in the Grade 12 NAEP and the 21 schools participating in the 17-year-old LTT Will be mailed mid-November either to the district office or directly to the schools, as designated by the DAC Purpose is to provide motivational materials to encourage the older students to participate in the assessment in a meaningful way 10

NAEP Assessment Schedule 2013 and – TUDA, State, and National Reading and Mathematics, grades 4 and 8. National and 11 states, including Florida, Reading and Mathematics, grade 12; National grade 4 Writing 2014 – National Civics, Geography, U.S. History, and Technology and Engineering Literacy 11

Florida State Statute, Revised by 2011 Legislature Student assessment program for public schools. (2) NATIONAL AND INTERNATIONAL EDUCATION COMPARISONS.— It is Florida's intent to participate in the measurement of national educational goals. The Commissioner of Education shall direct Florida school districts to participate in the administration of the National Assessment of Educational Progress, or a similar national or international assessment program, both for the national sample and for any state-by-state comparison programs which may be initiated.

International Assessments,con’t Florida will participate in benchmarking studies for Trends in International Mathematics and Science Study (TIMSS), Progress in International Reading Literacy Study (PIRLS), and the Program for International Student Assessment (PISA). Todd Clark, Director, Race to the Top Assessments, is responsible for managing Florida’s contract with Westat for TIMSS, PIRLS, and PISA. Michele Sonnenfeld is responsible for the coordination piece of the international assessments, just as she is for NAEP. 13

International Assessments Enable the U.S. to benchmark its performance to that of other countries Each is designed to serve a different purpose Each is based on a separate and unique framework and set of assessment items Participation in international assessments to measure state progress is required by Florida’s RTTT Application 14

Race to the Top (RTTT) Initiative 2, RTTT Activities Florida will increase resources for teachers to perform effective instruction through high-quality assessments by providing information that allows international comparisons of student achievement in Science, Technology, Engineering, and Mathematics (STEM) and literacy. 15

Race To The Top (RTTT), con’t Areas of need revealed by these measures will allow Florida to adjust priorities for development of resources and strategies prior to the initiation of the internationally-benchmarked common summative assessments of the Common Core State Standards (CCSS). 16

TIMSS 2011 Trends in International Mathematics and Science Study (TIMSS) –Measures student learning in mathematics and science since 1995 –Administered at grades 4 and 8 every 4 years in the spring –U.S. and Florida data will be compared to that of other countries – Results released in late 2012 or early 2013 –See handout for results from 2007 – nternationalScienceReport.pdfhttp://timss.bc.edu/timss2007/PDF/TIMSS2007_I nternationalScienceReport.pdf – 17

PIRLS Progress in International Reading Literacy Study (PIRLS) –Measures both trends in fourth-grade students’ reading literacy achievement, as well as school and teacher practices related to reading instruction since 2001 –Administered every 5 years in the spring. –U.S. and Florida data will be compared to that of other countries –Results released in late 2012 or early 2013 –See handout for results from 2006 –

TIMSS and PIRLS Participation 19

PISA Program for International Student Assessment (PISA) –Measures how far students approaching the end of compulsory education (15-year-olds) have acquired some of the knowledge and skills essential for full participation in an information society –Administered every 3 years in the fall. –U.S. and Florida data will be compared to that of other countries –Results released in late 2013 or early 2014 –See handout for results from 2009 – 0071e.pdfhttp://browse.oecdbookshop.org/oecd/pdfs/free/ e.pdf

PISA 2012 con’t 21 Will be administered September 24 to November 2, 2012 Focus will be on Mathematics Reading and Scientific Literacy will also be assessed Separate national and state samples Approximately 10 FL schools will be selected for the national sample and 50 FL schools for the state sample

PISA 2012 con’t School PISA coordinators will be invited to attend an informational meeting in DC that will include education experts from the U.S. and from other countries Westat staff will administer PISA, the same as with NAEP 22

Websites 23 For additional information about the International Assessments, please access For additional information about the Program, including the Long-term Trend Assessment, please access

Social Networking 24

Social Networking 25

Florida NAEP State Coordinator Michele Sonnenfeld 325 W. Gaines Street, Room 414 Tallahassee, FL