1. National Assessment of Educational Progress Felicia Mallory, Executive Director Denetra Collins, Staff Specialist

2. Overview of NAEP NAEP is mandated and funded by Congress and administered by the National Center for Education Statistics (NCES) in the U.S. Department of Education. Policy oversight is provided by the National Assessment Governing Board (NAGB). NAGB establishes the frameworks on which NAEP is based. Results of the assessments allow for comparisons between states and to the nation Results of NAEP are not connected to the No Child Left Behind measurement of adequate yearly progress (AYP). However, use of a common scale of achievement allows for the comparison of states’ assessment systems.

3. Florida State Statute 1008.22 (2) “The Commissioner of Education shall direct Florida school districts to participate in the administration of NAEP... both for the national sample and for any state-by-state comparison programs.” NAEP in Florida

4. Purpose of NAEP A common nationwide measure of student performance Reports changes over time. Provides results for the nation, states, and some urban districts. Secondary indicator for state progress and allows national comparisons between states and large urban districts Used by the President, Congress, and state leaders to set education policy

5. Features of NAEP Broad subject-area assessments based on NAEP frameworks Limited number of schools and students within schools Item sampling –students take only a subset of test items Administered across the country by contracted administrators – minimal burden to schools Contains multiple-choice and constructed response questions

6. Sampling Every school and student has a chance of being selected for the sample. The sample is designed to be representative of the entire student population. Lists of schools are obtained by Westat from the National Center for Education Statistics Common Core of Data (CCD).

7. Reporting of NAEP Results NAEP results are reported by: Scale scores – 0-300 or 0-500 depending on the subject Achievement levels – Basic, Proficient, Advanced Data is disaggregated by subgroups

8. Features of TUDA Provides district-level data to participating urban districts Provide a common yardstick to measure student achievement in comparison to  Other urban districts  States  Large Central Cities  National Public Schools  Census Regions

9. NAEP 2009 Assessed Components Operational Components Grades Reading4, 8, 12 Mathematics4, 8, 12 Science4, 8, 12 Pilots and Special StudiesGrades Reading4, 8 Mathematics4, 8 U.S. History, Civics, Geography4, 8, 12 Science Interactive Computer Tasks (ICT) and Science Hands- on Tasks (HOTs) 4, 8, 12 High School Transcript Study12 National Indian Education Study (NIES) 4, 8 Improving NAEP SES Indicator Study 4, 8, 12

10. NAEP Instrument Design Long Test, Short Booklet – Each student gets a small part of the test – No individual student scores Test Questions – Multiple-choice – Open-ended Background Items – Student, teacher, administrator questionnaires

11. Science Interactive Assessments Science Interactive Computer Tasks (ICT) ( One 40-minute extended task and two 20-minute short tasks) Science Hands-on Tasks (HOTs) (Two 20 –minute short tasks and one 40- minute extended tasks)

12. Pre Assessment Visits (PAV) Meet with Westat Assessment Coordinator Scheduled between January 6 through January 24, 2009 Allow about 2 hours Confirm participating students

13. Pre- Assessment Visit (PAV) Packet Contents Student Information Report—List of students selected for NAEP as well as their demographic information based on October FTE data NAEP SD and ELL Questionnaires (www.naepq.com)www.naepq.com Roster of Questionnaires If Grade 12, School Questionnaire U.S. Department of Agriculture Letter NAEP Logistics Questionnaire NAEP Red Storage Envelope Parent/Guardian Notification Letter

14. Preparing for the Pre-Assessment Visit (PAV)  Obtain current list of students from the Office of Student Assessment and Educational Testing.  Distribute SD and ELL questionnaires to teachers, who are directly involved with the SD and ELL students selected for the assessment.  Collect completed questionnaires prior to PAV  Complete the 2009 Logistics Questionnaire.  Prepare the parent/guardian notification letter.  Request testing locations.

15. Parent/Guardian Notification Letter By law, NAEP requires that parents/guardians of all selected students be notified in writing about the assessment. Notification must be signed by a school representative and dated on school letterhead stationary. A copy of the letter should be faxed to The Office Student Assessment and Educational Testing and be given to the NAEP Westat Assessment Coordinator during the PAV. Templates of this letter in English, Spanish, and Haitian- Creole will be provided to the schools in hard copy and posted on-line at http://www.fldoe.org/asp/naep/naep2009.asp http://www.fldoe.org/asp/naep/naep2009.asp

16. During the PAV The school NAEP coordinator will Provide work space or area to review materials with NAEP field staff Provide NAEP field staff with a current student enrollment list provided to you by SAET Verify student demographic information. Confirm withdrawn and newly enrolled students. Corrected NAEP Student Information Report Provide SD and ELL questionnaires Discuss and arrange accommodation sessions. Receive NAEP Teacher Questionnaires. Provide a copy of dated parent/guardian notification letter. Finalize assessment logistics with NAEP field staff after they have completed their paperwork.

17. After the PAV The school NAEP coordinator will Distribute the NAEP school and teacher questionnaires (the questionnaires can be completed online). Send parent/guardian notification letters to all students selected for the assessment. Notify the students of the assessment. Notify the teachers of the assessment. Place the NAEP Storage Envelope in a safe place.

18. Assessment Day Activities Have the NAEP Storage Envelope available for the NAEP field staff when they arrive at the school. Give completed NAEP teacher and school questionnaires to the NAEP field staff. Make sure all sampled students arrive promptly. Investigate reasons for student absences (e.g., suspensions, attending classes off campus, absences, etc.).

19. NAEP Inclusions and Accommodations Schools may exclude students according to carefully designated criteria. NAEP’s most frequent accommodations include: Extra testing time Individual or small group administrations Large-print booklets NAEP accommodations do not include reading passages or questions aloud on the NAEP reading assessment.

20. After the NAEP Assessment Participate in a short debriefing interview with the NAEP field staff. Schedule a make-up session, if necessary. Complete a short quality-control call with a Westat staff member. Only 25 percent of schools assessed will be called. Retain the NAEP Storage Envelope and destroy the contents on the last day of the academic year. Mail the provided postcard to Westat confirming that the materials have been destroyed.

21. Important Dates for NAEP 2009 TasksDate MySchool Registration and School Data Collection Form October 1, 2008 Assessment Coordinator will contact schools to schedule an assessment visit December 2008 Pre-Assessment packet arrives in selected schools By January 5, 2009 Pre-Assessment visits will be scheduled after registration January 6 – January 24, 2009 NAEP Testing Administration WindowJanuary 26 – March 4, 2009

22. Information for Parents If parents have questions or concerns about the NAEP assessment, please share the Sample Questions Booklet with them. The booklets are available on the MySchool Web site at www.MyNAEP.com and will be distributed to the schools during the PAV.

23. Information for Teachers and Students Videos available at the National Center for Education Statistics NCES: Introducing NAEP to Teachers Introducing NAEP to Students http://www.nces.ed.gov/nationsreportcard/about/school s.asp

24. Best Practices for Improving Twelfth-Grade NAEP Participation Includes:  Strategies effective in engaging Grade 12 students in NAEP  Talking points that principals can use with teachers and parents

25. Resources for NAEP NCES NAEP Website http://nces.ed.gov/nationsreportcard/ The Nation’s Report Card http://nces.ed.gov/nationsreportcard/ http://nces.ed.gov/nationsreportcard/ Florida’s NAEP Website (Parent and Student Letter Templates) www.fldoe.org/asp/naep Sample questions, initial release website http://www.nationsreportcard.gov Examples of background questions http://nces.ed.gov/nationsreportcard/bgquest.asp NAEP School Coordinator Packet http://oada.dadeschools.net/TestChairInfo/96NAEPSchoolCoordinatorPacket.pdf NAEP SD and ELL Questionnaires www.naepq.com Information for Parents http://nces.ed.gov/nationsreportcard/parents NAEP Data Explorer http://nces.ed.gov/nationsreportcard/naepdata/ NAEP Questions Tool http://nces.ed.gov/nationsreportcard/itmrls/