1. 1 New England Common Assessment Program Guide to Using the 2005 NECAP Reports: Companion PowerPoint Presentation March/April 2006

2. 2 Tim Kurtz – Director of Assessment, New Hampshire Department of Education Gaye Fedorchack – Coordinator of Alternate Assessment, New Hampshire Department of Education Harold Stephens – NECAP Program Director, Measured Progress Welcome and Introductions

3. 3 To assist schools and districts in using the variety of reports and support material issued by the NECAP states in conjunction with the release of results To provide school and district personnel an opportunity to ask questions regarding the reports and support materials Purpose of the Workshop

4. 4 Development of Grade Level Expectations Test Item Review Committees Bias and Sensitivity Review Committees Classroom Teacher Judgment data Standard setting panelists Technical Advisory Committee Involvement of Local Educators (Appendix A)

5. 5 Fall test – previous year’s GLEs Reading and Mathematics – grades 3-8 Writing – grades 5 and 8 Variety of Item Types Reading: multiple choice and constructed response Mathematics: multiple choice, short answer (one point), short answer (two points), and constructed response Writing: multiple choice, constructed response, and extended response Common and Matrix Items Basics of Test Design (Appendix A)

6. 6 Two Basic Types of Educational Tests Norm- Referenced: What is the student’s status or rank in a designated group? Criterion or Standards-Referenced: Has the student learned the skills or achieved the standard? NECAP is a Standards-Referenced Test

7. 7 Questions about Purpose of the Workshop and/or NECAP background? Questions and Answers

8. 8 Student Report Item Analysis Report Student-level data file (District) School/District Results Report School/District Summary Report Types of Reports

9. 9 Family Educational Rights and Privacy Act (4) The Family Educational Rights and Privacy Act (FERPA) Access to individual student results is restricted to the student, the student’s parents/guardians, and authorized school personnel. Superintendents and principals are responsible for maintaining the privacy and security of all student records. Authorized school personnel shall have access to the records of students to whom they are providing services when such access is required in the performance of their official duties. FERPA website: http://www.ed.gov/policy/gen/guid/fpco/ferpa/index.htmlhttp://www.ed.gov/policy/gen/guid/fpco/ferpa/index.html

10. 10 National Council on Measurement in Education (4) www.ncme.org

11. 11 Student Report (5) Two copies mailed to the school: color copy for parents/ guardians, black and white copy for local use Ensure that parents/guardians receive the color copy We recommend holding a School Report Night or parent conferences Dual sided: text side and data side

12. 12

13. 13

14. 14 Scaled Scores What are they? Why do we use them? Comparison across tests and years Precision How are they computed?

15. 15 x x 40 20 60 x 80 0 Cuts from Standard Setting Score Scale

16. 16 x x 40 20 60 x 80 0

17. 17 x x 40 20 60 x 0 80 X X

18. 18

19. 19

20. 20 Questions about the Student Report? Questions and Answers

21. 21 Rationale Inclusion of students in “Teaching Year” reports Teaching School vs. Testing School

22. 22 Teaching Year Testing Year

23. 23 Teaching school vs. Testing school Schools Can View Reports for Testing Year (2005-06) Grade 4 Students in 2005-2006

24. 24 Teaching school vs. Testing school Schools Can View Reports for Teaching Year (2004-05) Grade 3 Students in 2004-2005

25. 25 Item Analysis Report (9) Available to schools and districts on-line One per content area Use in conjunction with Released Items documents

26. 26

27. 27

28. 28 Released Item Documents

29. 29 Questions about the Item Analysis Report? Questions and Answers

30. 30 Available on-line Separate report for each grade level tested District report contains no individual school data School/District Results Report (12)

31. 31 http://iservices.measuredprogress.org

32. 32

33. 33

34. 34

35. 35

36. 36 Assessment and Accountability New England Common Assessment Program (NECAP) See how your school performed on the NECAP: Click here.Click here. NECAP Reports, Guides, Released Items (available at 11:00) Press Release NECAP FAQs Results by Grade Results by School Results by District Interpretation Guide for NECAP reports (PDF) Presentation to the SuperintendentsReleased Items Click here to download released NECAP test items For Principals and District and School Testing Coordinators 2005 NECAP Principal/Test Coordinator Manual (PDF) Accommodations, Guidelines, and Procedures: Administrator Training Guide (PDF) Grades 3 & 4 Tip Sheet (PDF) Multiplication Table for Grades 3 & 4 ONLY (PDF) Hundreds Chart for Grades 3 & 4 ONLY (PDF) Grades 5 - 8 Tip Sheet (PDF) 2005 Resource Materials and Practice Tests Be sure to check Registration and Materials for Workshops for specific workshop materialsRegistration and Materials for Workshops For Teachers 2005 NECAP Principal/Test Coordinator Manual (PDF) Accommodations, Guidelines, and Procedures: Administrator Training Guide (PDF) 2005 Resource Materials and Practice Tests Grades 3 & 4 Tip Sheet (PDF) Multiplication Table for Grades 3 & 4 ONLY (PDF) Hundreds Chart for Grades 3 & 4 ONLY (PDF) Grades 5 - 8 Tip Sheet (PDF) Friday, March 24, 2006 For Par ent s http://www.ed.state.nh.us/education/doe/

37. 37 Teaching Year Testing Year

38. 38 Page 2 of the NECAP School/District Results Report Summary of participation and results Grade Level Summary Report (18)

39. 39

40. 40

41. 41 Number of Scaled Score Points Denoting Minimally Statistically Significant Difference for Average Group Results* Grade Subject Number of Students Tested in Group (Class, School etc.) 102550100200 3 Reading 64321 Mathematics 53221 4 Reading 64321 Mathematics 64321 5 Reading 63221 Mathematics 53221 Writing 64321 6 Reading 64321 Mathematics 53221 7 Reading 64321 Mathematics 53221 8 Reading 64321 Mathematics 53221 Writing 53221 *Standard error of the mean difference with assumption n1=n2 and s1=s2

42. 42 Percentage Difference in Student Achievement Level Classification Denoting Minimally Statistically Significant Differences for Group Results* Percentages of Students in Category Number of Students Tested in Group (Class, School etc.) 102550100200 10 96432 20 138643 30 149653 40 1510753 50 1610754 60 1510753 70 149653 80 138643 90 96432 *0.05 level of statistical significance

43. 43 Questions about the Grade Level Summary Page? Questions and Answers

44. 44 Page 3, 5, and 7 of the NECAP School/District Results Report Provides information about achievement in subtopics of tested content areas Content Area Results (21)

45. 45

46. 46

47. 47 Questions About the Content Area Results Page? Questions and Answers

48. 48 Pages 4, 6, and 8 of the NECAP School/District Results Report Provides information about achievement for different groups in a school/district Disaggregated Content Area Results (23)

49. 49

50. 50 Questions About the Disaggregated Content Area Results Page? Questions and Answers

51. 51 Separate row for each grade level tested Provides details about student achievement by content area School/District Summary Report (25)

52. 52

53. 53 Questions About the School/District Summary Report? Questions and Answers

54. 54 Guide to Using the 2005 NECAP Reports and companion PowerPoint Grade Level Expectations Test Specifications documents Released Items documents Preparing Students for NECAP: Tips for Teachers to Share with Students Technical Report Supporting Materials www.ed.state.nh.us/education

55. 55 Contact Information Tim Kurtz Director of Assessment phone: 271-3846 email: TKurtz@ed.state.nh.us Gaye Fedorchak Coordinator of Alternate Assessment phone: 271-7383 email: GFedorchak@ed.state.nh.us Rich Andrusiak Mathematics phone: 271-3844 email: RAndrusiak@ed.state.nh.us Linda Stimson English Language Arts phone: 271-2035 email: LStimson@ed.state.nh.us Deb Fleurant Title I phone: 271-3838 email: DFleurant@ed.state.nh.us Jan McLaughlin Science phone: 271-3856 email: JMcLaughlin@ed.state.nh.us Ken Relihan Social Studies phone: 271-6151 email: KRelihan@ed.state.nh.us David Gebhardt NAEP phone: 271-2298 email: DGebhardt@ed.state.nh.us Measured Progress Service Center: 1-877-632-7774