1 New England Common Assessment Program Guide to Using the 2005 NECAP Reports: Companion PowerPoint Presentation March/April 2006

2 Tim Kurtz – Director of Assessment, New Hampshire Department of Education Gaye Fedorchack – Coordinator of Alternate Assessment, New Hampshire Department of Education Harold Stephens – NECAP Program Director, Measured Progress Welcome and Introductions

3 To assist schools and districts in using the variety of reports and support material issued by the NECAP states in conjunction with the release of results To provide school and district personnel an opportunity to ask questions regarding the reports and support materials Purpose of the Workshop

4 Development of Grade Level Expectations Test Item Review Committees Bias and Sensitivity Review Committees Classroom Teacher Judgment data Standard setting panelists Technical Advisory Committee Involvement of Local Educators (Appendix A)

5 Fall test – previous year’s GLEs Reading and Mathematics – grades 3-8 Writing – grades 5 and 8 Variety of Item Types Reading: multiple choice and constructed response Mathematics: multiple choice, short answer (one point), short answer (two points), and constructed response Writing: multiple choice, constructed response, and extended response Common and Matrix Items Basics of Test Design (Appendix A)

6 Two Basic Types of Educational Tests Norm- Referenced: What is the student’s status or rank in a designated group? Criterion or Standards-Referenced: Has the student learned the skills or achieved the standard? NECAP is a Standards-Referenced Test

7 Questions about Purpose of the Workshop and/or NECAP background? Questions and Answers

8 Student Report Item Analysis Report Student-level data file (District) School/District Results Report School/District Summary Report Types of Reports

9 Family Educational Rights and Privacy Act (4) The Family Educational Rights and Privacy Act (FERPA) Access to individual student results is restricted to the student, the student’s parents/guardians, and authorized school personnel. Superintendents and principals are responsible for maintaining the privacy and security of all student records. Authorized school personnel shall have access to the records of students to whom they are providing services when such access is required in the performance of their official duties. FERPA website:

10 National Council on Measurement in Education (4)

11 Student Report (5) Two copies mailed to the school: color copy for parents/ guardians, black and white copy for local use Ensure that parents/guardians receive the color copy We recommend holding a School Report Night or parent conferences Dual sided: text side and data side

12

13

14 Scaled Scores What are they? Why do we use them? Comparison across tests and years Precision How are they computed?

15 x x x 80 0 Cuts from Standard Setting Score Scale

16 x x x 80 0

17 x x x 0 80 X X

18

19

20 Questions about the Student Report? Questions and Answers

21 Rationale Inclusion of students in “Teaching Year” reports Teaching School vs. Testing School

22 Teaching Year Testing Year

23 Teaching school vs. Testing school Schools Can View Reports for Testing Year ( ) Grade 4 Students in

24 Teaching school vs. Testing school Schools Can View Reports for Teaching Year ( ) Grade 3 Students in

25 Item Analysis Report (9) Available to schools and districts on-line One per content area Use in conjunction with Released Items documents

26

27

28 Released Item Documents

29 Questions about the Item Analysis Report? Questions and Answers

30 Available on-line Separate report for each grade level tested District report contains no individual school data School/District Results Report (12)

31

32

33

34

35

36 Assessment and Accountability New England Common Assessment Program (NECAP) See how your school performed on the NECAP: Click here.Click here. NECAP Reports, Guides, Released Items (available at 11:00) Press Release NECAP FAQs Results by Grade Results by School Results by District Interpretation Guide for NECAP reports (PDF) Presentation to the SuperintendentsReleased Items Click here to download released NECAP test items For Principals and District and School Testing Coordinators 2005 NECAP Principal/Test Coordinator Manual (PDF) Accommodations, Guidelines, and Procedures: Administrator Training Guide (PDF) Grades 3 & 4 Tip Sheet (PDF) Multiplication Table for Grades 3 & 4 ONLY (PDF) Hundreds Chart for Grades 3 & 4 ONLY (PDF) Grades Tip Sheet (PDF) 2005 Resource Materials and Practice Tests Be sure to check Registration and Materials for Workshops for specific workshop materialsRegistration and Materials for Workshops For Teachers 2005 NECAP Principal/Test Coordinator Manual (PDF) Accommodations, Guidelines, and Procedures: Administrator Training Guide (PDF) 2005 Resource Materials and Practice Tests Grades 3 & 4 Tip Sheet (PDF) Multiplication Table for Grades 3 & 4 ONLY (PDF) Hundreds Chart for Grades 3 & 4 ONLY (PDF) Grades Tip Sheet (PDF) Friday, March 24, 2006 For Par ent s

37 Teaching Year Testing Year

38 Page 2 of the NECAP School/District Results Report Summary of participation and results Grade Level Summary Report (18)

39

40

41 Number of Scaled Score Points Denoting Minimally Statistically Significant Difference for Average Group Results* Grade Subject Number of Students Tested in Group (Class, School etc.) Reading Mathematics Reading Mathematics Reading Mathematics Writing Reading Mathematics Reading Mathematics Reading Mathematics Writing *Standard error of the mean difference with assumption n1=n2 and s1=s2

42 Percentage Difference in Student Achievement Level Classification Denoting Minimally Statistically Significant Differences for Group Results* Percentages of Students in Category Number of Students Tested in Group (Class, School etc.) *0.05 level of statistical significance

43 Questions about the Grade Level Summary Page? Questions and Answers

44 Page 3, 5, and 7 of the NECAP School/District Results Report Provides information about achievement in subtopics of tested content areas Content Area Results (21)

45

46

47 Questions About the Content Area Results Page? Questions and Answers

48 Pages 4, 6, and 8 of the NECAP School/District Results Report Provides information about achievement for different groups in a school/district Disaggregated Content Area Results (23)

49

50 Questions About the Disaggregated Content Area Results Page? Questions and Answers

51 Separate row for each grade level tested Provides details about student achievement by content area School/District Summary Report (25)

52

53 Questions About the School/District Summary Report? Questions and Answers

54 Guide to Using the 2005 NECAP Reports and companion PowerPoint Grade Level Expectations Test Specifications documents Released Items documents Preparing Students for NECAP: Tips for Teachers to Share with Students Technical Report Supporting Materials

55 Contact Information Tim Kurtz Director of Assessment phone: Gaye Fedorchak Coordinator of Alternate Assessment phone: Rich Andrusiak Mathematics phone: Linda Stimson English Language Arts phone: Deb Fleurant Title I phone: Jan McLaughlin Science phone: Ken Relihan Social Studies phone: David Gebhardt NAEP phone: Measured Progress Service Center: