1. NAEP 2019 Pre-Administration Workshop
10/2/2018 NAEP Pre-Administration Training 10:00 am – 12:00 pm
10/4/2018 NAEP Pre-Administration Training – LIVE Repeat 1:00 pm – 3:00 pm

2. AGENDA Overview Sampling School Coordinator Responsibilities
Assessment Process
Results
Resources

3. OVERVIEW

4. Testing Requirements
National Assessment of Educational Progress (NAEP)
Under the umbrella of the U.S. Department of Education
The Every Student Succeeds Act (ESSA) requires states/districts who receive Title I funding to participate in the biennial NAEP assessment in reading and mathematics at grades 4 and 8.
Georgia law and State Board of Education rules require participation in all NAEP assessments.

5. Unique Features of NAEP
National testing program, same assessment in every state
Sample of schools to represent demographics of state
Students in selected schools are sampled
Each student is only assessed in one pre-assigned subject
Results for state or selected district only
Assessed subjects vary by year
Contracted assessment team
Six month results window
Results can be aggregated by demographic variables
Special research studies

6. NAEP Grade Levels and Content Areas
Developed by the National Assessment Governing Board (NAGB)
Grades and ages
Grades 4, 8 and 12
Ages 9, 13, and 17 (Long-term trend)
Developed frameworks and assessments
Reading - Economics
Mathematics - Civics
Science - Foreign language
U.S. History - Writing
Geography - The Arts

7. NAEP Purpose
To measure student achievement in the context of instructional experiences.
To track achievement of fourth-, eighth-, and twelfth- graders over time in selected content domains.
To provide the only comparison to the achievement of students in every other state in the nation.
To provide the comparison of the students in each state to the students enrolled in the nation’s public schools.

8. SAMPLING

9. NAEP Representative Sample
NAEP is designed to report results at the national and state level
Results for selected trial urban districts (TUDA); Atlanta is a TUDA
Every student in every school not required to take the assessment
A sampling frame created using the Common Core of Data (CCD)
NAEP administered to a sample of students from this frame who represent the student population of the nation as a whole and of individual states and districts participating in the Trial Urban District Assessment (TUDA).

10. School Selection

11. Student Selection Students selected based on grade (4, 8 or 12)
List of all enrolled students submitted to NCES
Students randomly selected
Every student is eligible to be selected
Sampled students assigned to only one subject
In general, 30 students per subject, per grade
SD and ELL students can receive NAEP approved accommodations
No implication for students who do not receive accommodations because neither students nor schools receive scores

12. Subject Selection

13. NAEP 2019 Program     National 4 & 8 State/TUDA 4 & 8 National 12
2 DBA sessions
25 students each
1 DBA session for PR
National 4 & 8
1 PBA, students
National 12
19 students each
1 PBA, 30 students
Mathematics
 
State/TUDA1 Puerto Rico 
Pilot2 
National3
Reading
State/TUDA1
Science
Vocabulary
Special studies with additional student questionnaires:
1=National Indian Education Study (NIES), 2=Extended Student Questionnaire (ESQ, or “SES-SQ”), 3=Computer Access and Familiarity Study (CAFS)
Assessment window = 1/28/19 – 3/8/19 

14. 2019 Georgia Sample 2019 State Results
Mathematics
Reading
Georgia Schools (excluding TUDA)
Grade 4: 140 schools
Grade 8: 151 schools
Grade 12: 60 schools
TUDA
4th and 8th grade only
78 schools

15. 2018/19 International Participation
International Computer and Information Literacy Study (ICILS)
Computer based assessment for 8th graders
Measure skills and experiences using technology to investigate, create, and communicate
More than 20 countries
International Early Learning Study (IELS)
Tablet based study of children’s emergent skills of 5- and 6-years olds
Literacy, numeracy, empathy and trust, and self-regulation
Multiple countries
Program for International Student Assessment (PISA)
Assessment of reading, mathematics, science literacy and financial literacy of 15-year olds
More than 70 countries
Teaching and Learning International Survey (TALIS)
Online survey of teachers of grades 7-9 and the principals of the schools
Describe conditions related to teaching in their schools and successes and challenges faced by school leaders
More than 40 countries
Trends in International Mathematics and Science Study (TIMSS)
Tablet based assessment of 4th and 8th graders
More than 60 countries

16. SCHOOL COORDINATOR RESPONSIBILITIES

17. NAEP Important Dates
District Superintendents notified of school selection in June
System Test Coordinators notified of school selection and assessment dates in June
Principals of sampled schools notified in August; school coordinator responsibilities sent; reschedule requests being taken now
Contact from NAEP assessment team in early December
NAEP assessment – last week in January through first week of March
January 29 to March 9, 2019

18. What is MyNAEP? www.mynaep.com
MyNAEP serves as your primary resource and action center for the NAEP assessment.
All preassessment activities are completed via MyNAEP.
The site contains confidential information, so all users will be prompted to accept a confidentiality agreement.
Requires a username and password.

19. MyNAEP Activity Timeline1 3 2 4 5
Register for MyNAEP
Provide School Information
Prepare for Assessment
Support Assessment Activities
Wrap Up
August - September
December - January
One week before the assessment
After the assessment

20. Getting Started on MyNAEP
How to Register for MyNAEP
The first MyNAEP School Coordinator task is to:
Register on the MyNAEP website and familiarize yourself with the website,  
All required tasks and information will be posted here.  
Review the list of School Coordinator activities by early October.

21. How do I register for the site? (Completed)
Each school received a MyNAEP registration ID.

22. How do I register for the site (cont’d)?

23. Recovering your password
Select the “Forgot Password” link
Enter your address
Receive with temporary password
Login with temporary password
Create new password

24. Provide School Information (Completed)

25. Submission of Student List (Due in mid-November)
Submitted by NAEP State Coordinator for all schools
Students in sampled grade only
List provided by DOE Technology group
Student Information
Name
GTID
MOB, YOB
Gender
Ethnicity
Race SD
ELL
Lunch Status (Provided by school later)
Economically Disadvantaged

26. Prepare for Assessment
The Prepare for Assessment menu includes 7 activities
Only school coordinators and principals have full access to this menu
The list of selected students will be posted under Review and Verify List of Students on December 3rd
All 7 tasks should be completed before the scheduled preassessment review call

27. Prepare for Assessment: How does it work?
Each activity has a tutorial video and a “Additional Resources” section
On average, the videos are about 5 minutes each
Resources are helpful documents that support the activity

28. Prepare for Assessment: How does it work?
Each activity has a tutorial video and a “Additional Resources” section
On average, the videos are about 5 minutes each
Resources are helpful documents that support the activity

29. Prepare for Assessment: How does it work?
The menu serves as a “virtual checklist”
Checkmarks will appear after activities are completed
White checkmarks indicate information that will be confirmed by your NAEP representative during the preassessment review call

30. Prepare for Assessment: How does it work?
During the preassessment review call, the NAEP representative will review and confirm all activities
The white checkmarks will turn green
Green checkmarks indicate that the information is in “read only mode”
Contact your NAEP representative to make any changes

31. Prepare for Assessment: How does it work?
The first 6 activities will be available on December 3rd
Please complete these before winter break
Update Student List will be available in January
Complete this last activity when you return from winter break

32. Prepare for Assessment: Review and Verify Students
Review the list of selected students, and make the following updates
Identify students who are withdrawn, no longer enrolled, foreign exchange, not attending classes on campus, not in the selected grade
Update any missing or incorrect demographic information
Update classifications for students with disabilities, 504 plan students, and English Language Learners

33. Prepare for Assessment: Complete SD/ELL Information
Select Complete SD/ELL Student Information. This section will become available on the MyNAEP website in December
Provide information for students with disabilities (SD) and English language learners (ELL) who are in the sample.
If you do not see a student sampled for NAEP who is SD and/or ELL in this section, you must return to the Review and Verify Information for Student Selected for NAEP section and correct their status here.
Fig. 1

34. Prepare for Assessment: Complete SD/ELL Information
Provide additional information about students with disabilities (SD) and English language learners (ELL)
How each student is assessed on the state assessment
Testing accommodations that each student typically receives
The IDEA category that best describes the student’s disability
How long each student has been enrolled in U.S. schools (ELL)
Level of English proficiency (ELL)
State Inclusion Policies are posted on MyNAEP page

35. Prepare for Assessment: Complete SD/ELL Information
School coordinators can assign this task to SD/ELL specialists
Enter the names and addresses of up to 5 specialists
They will receive an with registration info

36. Prepare for Assessment: Notify Parents
Download and distribute the parent/guardian notification letter template
Customize text and include school letterhead
Verify that parents/guardians of all sampled students were notified by entering the date the letter was sent
Upload an electronic copy of the customized parent letter

37. Prepare for Assessment: Manage Questionnaires
Enter the names and addresses of questionnaire recipients, then send links to online questionnaires
The school questionnaire is assigned to the principal
Teachers at grade 4 & 8 schools should be assigned teacher questionnaires
Teachers of American Indian/Alaska Native students will be assigned an additional questionnaire

38. Prepare for Assessment: Plan for Assessment Day
Assign a location and time for each assessment session and answer logistics questions
Let the NAEP representative know where to park at the school, how to check in, and what to do if there is a weather delay

39. Prepare for Assessment: Encourage Participation
Use recommended strategies to inform students and teachers about NAEP
Includes short 5 minute videos for teachers and students about the importance of NAEP

40. Prepare for Assessment: Update Student List (Excel)
Create an Excel list of all currently enrolled students after January 1, 2019
NAEP uses this list to give newly eligible students an opportunity to be sampled
The list should include the following information for each student:
State-level unique student ID *optional, no SSNs
First name
Middle name *optional
Last name
Month of birth
Year of birth

41. Prepare for Assessment: Update Student List
School coordinators can assign this task to a data specialist
The specialist will receive an with registration info

42. Support Assessment Activities
Print reminders about the scheduled NAEP assessment
Student appointment cards
Teacher notification letter
List of sampled students (attachment for letters)
Optional section
Recommended timeframe: 1 week before the assessment

43. Wrap Up
Safeguard all materials until the date noted on the red NAEP storage envelope
You will receive an reminder at that time to destroy the contents of the storage envelope in a secure manner

44. MyNAEP Resources Live chat Videos* Tutorials
NAEP Help Desk, NAEP(6237) or
*Videos available for each step of the process, will answer many questions that might arise

45. ASSESSMENT PROCESS

46. Assessment Details Contracted assessment team
All materials brought to school on assessment day
Pre-determined locations
Separate accommodations sessions
Assessment resides on tablets

47. Assessment Components
Digitally based assessment transition
Science interactive computer tasks
Science hands-on tasks
Student questionnaires

48. Assessment Components

49. Assessment Components

50. Assessment Components

51. Assessment Components https://nces. ed

52. RESULTS

53. NAEP Test Score Ranges
Average scale scores and achievement levels reported for reading, mathematics and science.
Example scale scores
Range is for reading and mathematics
Range is for science
Achievement levels
Advanced, Proficient, Basic
Indicate the percentage of students within the total population, or in a particular subgroup, that meet or exceed expectations of what they should know and be able to do.

54. NAEP Results NAEP website All previously released results

55. International Results
National Center for Education Statistics (NCES)
ICILS
IELS
PIRLS
PISA
TALIS
TIMSS

56. Use of NAEP Data Large database of released items
Sub-group aggregation of results
Comparison of results to other states
Results in context of teacher and school characteristics
Results in context of student experiences

57. RESOURCES

58. NAEP Resources NAEP Questions Tool
More than 2000 questions from previous assessments
Scoring guide
Actual student responses
Question performance data

59. NAEP Resources
NAEP Questions Tool (Cont’d)

60. NAEP Resources NAEP Data Explorer
National, state, region, district, and subgroup results
Demographic survey data

61. NAEP Resources
NAEP Data Explorer (cont’d)

62. NAEP Resources
NAEP Explorer (cont’d)

63. NAEP Resources
NAEP Explorer (cont’d)

64. NAEP Informational Video
Posted on NAEP page of Assessment link of DOE website
Assessment/Assessment/Pages/NAEP.aspx

65. NAEP State Coordinator
Bobbie Bable

66. Questions?