2. NAEP 2017 Campus Testing Coordinator (CTC) Training October 2016
National Assessment of Educational Progress (NAEP) Trial Urban District Assessment (TUDA)
NAEP 2017 Campus Testing Coordinator (CTC) Training
October 2016

3. NAEP Overview NAEP Background information
Trial Urban District Assessment
Criteria for TUDA Project
Who takes NAEP?
Participation Policies
Role of Campus Test Coordinator
Key Players for NAEP
Managing MyNAEP Website
Provide School Information
Prepare for Assessment
Review and Verify List of Students Selected for NAEP
Pre-assessment Review Call
Results
Accommodations
Timeline of Events
Contacts

4. What is NAEP?

5. About NAEP National Assessment of Educational Progress
Established in 1969.
The National Assessment of Educational Progress (NAEP) is referred to as The Nation’s Report Card.
Provides an essential measurement of student achievement in America in core subjects like mathematics, reading, science, and writing.
It is the only nationally representative assessment
It reports on student achievement at the national and state levels as well as selected urban districts.

6. TUDA Trial Urban District Assessment
The Trial Urban District Assessment (TUDA) is a special project within the main NAEP of the National Center for Education Statistics, the National Assessment Governing Board (NAGB), and the Council of the Great City Schools to determine the usefulness of reporting district-level results.
TUDA assesses the performance of public school students at the district level in grades 4 and 8.
NAEP has served as a framework for reporting district level results.

7. Criteria for TUDA Project
Must be located in large cities having a population of 250,000 or more.
Must be large enough to support a three-subject assessment cycle for NAEP in grade levels included in the state assessment program.
Must have a majority (50 percent or more) of students meeting at least one of the following criteria:
Either African American or Hispanic.
Eligible for participation in the National School Lunch.

8. Who takes NAEP?
The sample of schools drawn for the TUDA assessment is representative of all students in the district.
A random sample of students is selected.
The sample of students in the participating TUDA school districts is an extension of the sample of students who would usually be selected by NAEP as part of state and national samples.
The numbers of students assessed vary across the districts include students with disabilities (SD) and English language learners (ELL) provided with accommodations.

9. NAEP Participation Policies
Encourage participation without altering assessment constructs
Attain comparable inclusion rates across states and districts
Goal to include 95% of all students
Will prominently display jurisdiction meeting the goal in
national reports
Goal to include 85% of SD and ELL
Will identify jurisdictions falling below in national reports

10. The Role of NAEP/TUDA Campus Testing Coordinator (CTC)
You are the liaison for all NAEP assessment activities in your school.
Work with NAEP field staff during Pre- assessment Review Call (PRC) and during testing.
Monitor and maintain MyNAEP website (

11. Key Players for NAEP
NAEP State Coordinator – is the chief resource to district.
District TUDA Coordinator – serves as overseer for district’s assessment.
Campus Test Coordinator – liaison between NAEP field staff and campus.
NAEP Field Staff:
Field Managers (Paper and Pencil/Digital Based Assessment) – partner with NAEP State Coordinator and District TUDA Coordinator
Field Supervisor – troubleshoots all testing matters.
Assessment Coordinator – works with CTC regarding testing arrangements.
Assessment Administrator – serves as proctor for test administration.

12. Campus Test Coordinator District TUDA Coordinator
(CTC)
District TUDA
Coordinator
(DTC)
NAEP State Coordinator
(NSC)
NAEP
Field Manager
(FM)
Field Supervisor
(FS)
Assessment Coordinator
(AC)
Assessment Administrator
(AA)

13. CTCs Monitor and Maintain MyNAEP
The MyNAEP website provides a direct communications link to NAEP that shows the campus what to expect throughout the NAEP assessment process.
NAEP and the State Coordinator can provide information and instructions to schools and respond to specific questions.
CTCs are to log onto and select Please Register for registration using the assigned eight-digit ID. Refer to slides 15 – 18.
Complete the Provide School Information section (no later than October 7, 2016). See slides 20 – 22.
The District Coordinator submits the student file for the campuses in November 2016 and will complete the Update Student List in January 2017.

14. My NAEP Website (www.mynaep.com) Registration

19. My NAEP Website (www.mynaep.com) Provide School Information

23. My NAEP Website (www.mynaep.com) Prepare for Assessment

26. My NAEP Website (www. mynaep
My NAEP Website ( Pre-assessment Review Call (PRC) Activities

27. When Will I Be Contacted by NAEP?
In early December, a NAEP staff member will make an introductory call to set up your pre-assessment review call (PRC).
PRC will be in January 2017 prior to test date.
PRC will be listed on the MyNAEP website.

28. To do List before to the PRC
Complete Prepare for Assessment tasks
Review and Verify List of Students Selected for NAEP (available for viewing on December 5, 2016)
Complete SD/ELL Student Information
Notify Parents
Manage Questionnaires
Plan for Assessment Day
Encourage Participation
Update Student List

29. How Do I Prepare for the PRC?
Locate the pre-assessment packet that should arrive in early December
Await verification call from NAEP staff that packet has arrived and ask questions
Review all items in packet
Distribute SD/ELL questionnaires to staff most knowledgeable on how students test on STAAR
Send parent notification letter (Sample on MyNAEP)

30. What Happens During the PRC?
You will work with your AC to:
Confirm students that have withdrawn since
the student list was submitted.
Confirm additional students added to the
assessment.
Confirm missing or corrected student
demographic data.
Review the SD and ELL Worksheets and
discuss accommodations.
Receive School and Teacher Questionnaires.
Provide a dated copy of the Parent/Guardian
Notification Letter.
Discuss Logistics Information Form.

31. Texas NAEP Accommodations for English Language Learners (ELL) and Students with Disabilities (SD)

43. On NAEP Test Day
CTC will provide a work area for NAEP staff before, during, and after the assessment.
NAEP staff provides all assessment materials and conducts sessions.
CTC is responsible for making sure sampled students attend sessions.
Attendance rates need to be high as possible to meet the 95% participation requirement.
CTC should assemble a team of campus staff to assist with troubleshooting during the test.
NAEP staff administer the tests but do not have your authority over the classroom

45. Results

46. NAEP Assessments . . .
have no student-level results (each student gets only a small part of the complete assessment);
have no school-level results;
TUDAs only have district-level results;
are not designed to assess student achievement against expectations of a specific curriculum.
NAEP assessments allow comparisons across states and to the nation; state assessments do not.

47. How are NAEP results reported?
NAEP results are presented in two ways: as scale
scores and as percentages of students attaining
achievement levels.
Scale scores describe what students know and can do.
(0-500 depending on test)
Achievement levels describe what students should know and be able to do.
Basic: partial mastery of prerequisite knowledge and skills for fundamental proficiency
Proficient: solid academic performance, demonstrated competency over challenging subject matter
Advanced: superior performance

48. Dallas NAEP Grade 4 Math Results 2011, 2013, and 2015
Figure 1: Grade 4 Math Comparisons by Demographic Category, 2011, 2013, and 2015
Significant gains were made in fourth- grade math from 2013 to 2015.
All student groups demonstrated an increase in performance from 2013 to
Dallas black students demonstrated an upward trend in performance.
Dallas Hispanic students continued an upward trend in student performance.
Dallas English language learners demonstrated an upward trend in student performance.
Dallas economically disadvantage students continued an upward trend in student performance.

49. Dallas NAEP Grade 8 Math Results 2011, 2013, and 2015
Figure 2: Grade 8 Math Comparisons by Demographic Category, 2011, 2013, and 2015
Grade 8 demonstrated a decline in math performance from 2013 – 2015.
Dallas Black students held steady compared to 2013.
Dallas Hispanic students registered a decline compared to 2013.
English language learners in Dallas registered a decline compared to 2013.
Dallas economically disadvantage students performed similarly to those in national public schools.

50. Dallas NAEP Grade 4 Reading Results 2011, 2013, and 2015
Figure 3: Grade 4 Reading Comparisons by Demographic Category, 2011, 2013, and 2015
Grade 4 students demonstrated a decline in reading performance from 2013 to 2015.
Dallas black students registered no significant difference in performance from the previous test administration.
Dallas Hispanic students saw a decline in performance compared to the previous test administration.
English language learners in Dallas experienced a decline in performance.
Dallas students identified as economically disadvantaged saw a slight decline in performance compared to 2013.

51. Dallas NAEP Grade 8 Reading Results 2011, 2013, and 2015
Figure 4: Grade 8 Reading Comparisons by Demographic Category 2011, 2013, and 2015
Grade 8 students demonstrated a slight decline in performance from 2013 to
Black students showed a slight decline.
Hispanic students held steady compared to 2013.
English language learners’ performance was consistent with the previous test administration.
Performance for economically disadvantaged students registered a slight decline compared to 2013

52. Calendar of Events Dates and Deadlines Activity June 2016
District were notified of schools selected for NAEP 2017.
Principals received an notification.
August 2016
Principals were sent School Coordinator letter (assessment dates were included).
September 2016
Window for School Coordinator to complete the Provide School Information (PSI) on MyNAEP website.
October/November 2016
E-file—October 3 – November 11 (will be submitted by Assessment Programming Support)
December 2016
Pre-assessment Packets arrive at schools;
Initial call from NAEP field staff;
Student list available to view (December 5)
January/March 2017
Assessment dates (January 30 – March 10)
Pre-assessment Review Call (PRC) from NAEP Assessment Coordinator (begins the week the district returns from Winter Break)

53. Contacts Robert Mount, Ph. D Director of State and National
Assessments (SNA)
Evaluation and Assessment
Frederick Washington
Assessment Specialist/ District
TUDA Coordinator
State and National Assessments
Dr. Charlenta Govan
Districtwide Campus
Testing Coordinator
Kim Ackermann
State NAEP Coordinator