Presentation on theme: "NAEP National Assessment of Educational Progress Alaska."— Presentation transcript:
NAEP National Assessment of Educational Progress Alaska
What is NAEP? NAEP is the only nationally representative and continuing assessment of what Americas students know and can do in various subject areas. It is the most comprehensive national measure of students learning outcomes at critical junctures in their school experience.
Who heads NAEP? NAEP is an assessment conducted by the National Center for Education Statistics (NCES) for the United States Department of Education. Governed by the National Assessment Governing Board (NAGB)
2003 NAEP The No Child Left Behind Act mandates that any state wishing to receive a Title 1 grant must include an assurance beginning in 2002-2003 the state will participate in the biennial state-level NAEP in reading and math at grades 4 and 8. –Federal government will pay for administration –The state gives permission for NCES to release results and data –State participation in other NAEP assessments are voluntary –There will be not rewards or sanctions to states or LEAs on state NAEP results –Participation is not a substitute for the states own assessment
NAEP Provides State and National performance results National student results Trends in national student performance for the last 30 years Comparisons in student performance based on such factors as race/ethnicity, gender, public and private schools, level of parental education, prior course taking, and classroom and school conditions and practices.
Available NAEP Information National and State report cards on student performance Sample test questions, sample student answers, and scoring rubrics Assessment subject-area frameworks On-line data tool that allows users to analyze and download data from NAEP assessments
National average geography scale score results grades 4,8,12 National geography achievement level results * Significant change
How does NAEP plan to obtain data for both subjects and grades? Assessing an equal sample size for each states public schools About 100 schools for each grade (4 and 8) and subject (math and reading 2003) About 2,500 to 3,000 assessed students for each grade and subject Administering background questions to students, teachers, and principals in order to examine the relationship between performance on the assessment and a variety of important demographic, instructional, and school variables Alaska has 289 schools selected 64 students will be randomly selected from each school. The assessment will be administered between January 27 th and February 28th.
Hamilton Elementary/Middle 555 School Rd Hamilton TS 99222 After clicking on the Login button, she is asked to verify her school information: School Confirmation Screen To ensure that the correct ID was entered, the screen displays the school name and address matching the NAEP ID number that Dr. Smith entered. If she selects No, she will be taken back to the MyNAEP log in screen so she can enter the correct school ID.
If she selects Yes, she is taken to a screen with the registration form. Registration Form Here, Dr. Smith enters her name, title, phone number, a password that she has created, and her email address. The user is asked to enter the email address twice to be sure that it is entered correctly. If the same email information is not entered in the confirmation field, when the user clicks the Continue button, he/she receives this notice. Clicking on the OK button returns the user to the form so that the correct the conformation can be entered.
Dr. Smith clicks on the Continue button (with her email address entered correctly), and she is asked to confirm all of her entries in the next screen. Confirm Information Screen If she notices a mistake, she can return to the registration screen to correct it by selecting Modify your information.
If everything is OK, she selects the Submit button and is shown her new User Name and reminded of her password. Registration Complete screen. The text on this screen directs her to write down her new User Name and her password for future reference and to click on theMyNAEP Login page hyperlink to go to the MyNAEP login screen. Logging In With Personal Information
After selecting the login page hyperlink, Dr. Smith enters her User Name and Password to go to her schools MySchool site. MySchool Step 1 Screen The Log Off button is available in the upper right corner of the screen at all times.
Once you register for MySchool you will be able to access everything you will need to understand the NAEP process receive technical assistance.
A typical assessment day Before the Assessment AA arrives one hour before assessment. AC retrieves NAEP storage envelope from school coordinator AC assigns any accommodation booklets if necessary AA receives materials needed for sessions AA prepares bundles by affixing removable student ID labels AA and AC prepares room and sets out materials for session AA checks role and advise AC and school coordinator of missing students AC assists school coordinator with getting missing students to sessions AC =Assessment Coordinator AA =Assessment Administrator
A typical assessment day During the session AA follows the script to distribute materials AA monitors session, using classroom management strategies AA follows guidelines for assessing SD and LEP AA collects materials accounting for all of them AA dismisses students according to schools preference AC monitors the sessions and assists AA with any problems AA = Assessment Administrator AC = Assessment Coordinator
A typical assessment day Activities after the assessment NAEP staff determine reasons for absences NAEP staff record Administration codes on schedule NAEP staff completes summary information on schedule NAEP staff prepares materials to be left at school AC collects questionnaires from school coordinator AC schedules makeup session if necessary AC conducts debriefing interview AA =Assessment Administrator AC =Assessment Coordinator
Background Questionnaires Student, Teacher, Principal Teachers Years of teaching Type of certificate Undergraduate and Graduate work Professional Development Classroom Organization Students Ethnic background Newspaper at home Magazines at home Books at home Computer at home Pages read a day Watching TV Days absent Parents education level
Questions Tool Type of Question Relate a Fraction to 1 Identify Instruments of Measurement Write an Expression Using N Use Data from a Pictograph Choose Number Sentence Count Cubes in Solid Solve Word Problem Involving Division & Remainder Relate Perimeter to Side Length Determine a Probability Compare Two Geometric Shapes Compare Geometric Shapes USING AN INQUIRY OF MATHEMATICS IN THE FOURTH GRADE
7. 7. Ms. Hernandez formed teams of 8 students each from the 34 students in her class. She formed as many teams as possible, and the students left over were substitutes. How many students were substitutes? Answer:____________________ Question Performance DataPerformance Data Content Class ificationContent Class ification Scoring Guide /KeyScoring Guide /Key Student Res ponsesStudent Res ponses More DataMore Data Description:Solve Word Problem Involving Division & Remainder Question 7 of 117
Subject: Math Grade: 4 Block: 1996-4M9 No.: 07 1996 National Performance Results Note: These results are for public and nonpublic school students. Percentage may not add to 100 due to rounding. ScorePercentage of Students Correct Incorrect Omitted Item Off Task 39% 53% 8% 0%
Subject: Math Grade: 4 No.: 07 Mathematical Content Area Number sense, properties, and operations This question measures number sense, properties, and operations. This content area focuses on students' understanding of numbers (whole numbers, fractions, decimals, integers, real numbers, and complex numbers), operations, estimation, and applications to real-world situations. Students are expected to demonstrate an understanding of numerical relationships as expressed in ratios, proportions, and percents. Students are also expected to understand properties of numbers and operations, generalize from numerical patterns, and verify results. Number sense includes questions that address a student's understanding of relative size, equivalent forms of numbers, and use of numbers to represent attributes of real-world objects and quantities. This question also focuses on the subtopic of using computation and estimation in applications. Mathematical Ability Problem solving This question measures students' problem solving ability. Students demonstrate problem solving in mathematics when they recognize and formulate problems; determine the consistency of data; use strategies, data, models; generate, extend, and modify procedures; use reasoning in new settings; and judge the reasonableness and correctness of solutions. Problem solving situations require students to connect all of their mathematical knowledge of concepts, procedures, reasoning, and communication skills to solve problems.
NAEP Data Tool SUBJECT Math GRADE 4th STATE/JURISDICTION Alaska CATEGORY –MAJOR REPORTING GROUPS –STUDENT FACTORS –FACTORS BEYOND SCHOOL –INSTRUCTIONAL CONTENT AND PRACTICE –TEACHER FACTORS –SCHOOL FACTORS –COMMUNITY FACTORS –GOVERNMENT FACTORS
Student Factors All can do well in math if they try Below, at, or above age of most students in grade Days of school missed Difficulty of this math test Effort on this math test Gender Good at math Hispanic background Importance of success on this math test Language other than English spoken in home Length of time lived in United States Like math Math is mostly memorization Math is useful for everyday problems Number of grades attended in this state Only one correct way to solve math problems Questions correct on this math test Race/ethnicity used for NAEP reporting Alaska/Mathematics Composite/Accommodations Not Permitted/Grade 4/1996 How much do you agree with the statement? Everyone can do well in mathematics if they try. (student-reported) [M811110] Average Scale Score and Row Percentage (with Standard Errors in Parentheses) OVERALL AgreeUndecidedDisagree N Avg. Score( S.E. ) Row Pct.( S.E. ) Avg. Score( S.E. ) Row Pct.( S.E. ) Avg. Score( S.E. ) Row Pct.( S.E. ) Total 2181 226( 1.2) 87%( 1.0) 225( 3.9) 9%( 0.8) 209( 7.9) 4%( 0.5) NAEP Data Tools Alaska 1996
NAEP Reading Framework Reading Framework To Gain Information Focus on specific information Primary and Secondary articles Sections of textbook chapters Essays and speeches To Perform a Task Applying information or Direction to complete task Classified Ads Directions to complete Tax Forms For Literacy To enlarge on experience Of Human Events Adventure Science Fiction Folktales
Math Framework Number Sense, Properties, and Operations Measurement Geometry and Spatial Sense Data Analysis, Statistics, and Probability Algebra And Functions
State Department Website NATIONAL ASSSESSMENT OF EDUCATIONAL PROGRESS (NAEP) Data Collection Forms Instructions for Preparing a List of 4th Grade Students Instructions for Preparing a List of 8th Grade Students School Data Collection Form Resources NAEP Homepage NCES Homepage Question Tools for Teachers School Responsibilities for NAEP NAEP State Assessment Information Especially for Parents Parent Notification Letter Parent Notification Letter (Spanish) Parent Information for School Newsletter Especially for Principals Letter to Principals Personnel/Questions
Websites that will help explain NAEP NAEP Homepage http://nces.ed.gov/nationsreportcard/ Kids Quiz page w/NAEP questions http://nces.ed.gov.nceskids/kidsquiz/index.asp?flash=true NCES Homepage http://nces.ed.gov/nationsreportcard/sitemap.asp Questions tool for Teachers http://nces.ed.gov/nationsreportcard/itmlrs/ NAEP State assessment information http://nces.ed.gov/nationsreportcard/about/state.asp School responsibilities for NAEP http://nces.ed.gov/nationsreportcard/about/stateactivities.asp
National Assessment of Educational Progress (NAEP) Form Number Form NameDate Due 05-03-020 Instructions for Preparing a List of 8th Grade Students Instructions for Preparing a List of 8th Grade Students 05-03-021 Instructions for Preparing a List of 4th Grade Students Instructions for Preparing a List of 4th Grade Students Nov. 15 05-03-022 School Data Collection Form Nov. 15 State Department Assessment Website Forms and Grants