1. Assessment 2010

2. Downloaded and printed from www.sreb.orgwww.sreb.org Tasks and Timelines Random sampling instructions Student roster form Checklist for test coordinators Information for sites bulletin Test description & sample questions Test Administration guide Downloaded and printed from WVDE Course matching chart Concentration chart Assessment Administration Materials

3. This assessment is an important tool for linking students academic performance with school and classroom practices Purpose

4. Subject tests referenced to the new 2009 NAEP frameworks Modified to reflect college- and career- readiness component Student survey revised New school report format and introducing student reports

5. Student Survey Questions concerning student perceptions about academic and career/technical experiences Transcript of courses taken and credits acquired Academic Assessments that contain multiple choice and open-ended questions Reading Mathematics Science

6. The window for the 2010 HSTW Assessment is January 29 - February 19, 2010 Plan ahead to get the best results! Assessment Window

7. Each regular HSTW site will assess up to sixty seniors High school seniors are chosen, according to the sampling plan selected SUGGESTION: Begin the testing roster with students who will have completed four (4) credits in a career/technical concentration by graduation Each 21 st century HSTW site will assess all seniors

8. School #1 has identified 33 CTE completers; all 33 plus a random sample of remaining seniors to equal 60 total seniors will be assessed. School #2 has identified 51 CTE completers; school #2 will only test 51 students. Do not fill sample with remaining non-CTE students. Rule of Thumb: Randomize from non-CTE completers if the number of CTE completers is <50 to test a sample of 60 students.

9. School #3 has identified 83 CTE completers. School #3 must use the random sampling instructions to determine which 60 of their 83 CTE completers will be assessed.

10. Option 1- Using Random Number Table Option 2 – Using Excel Spreadsheet

11. Students with Disabilities Students participating under non-standard test conditions will code an F-9 on their answer document English language learners Career Technical students will be tested in their home high school Code E-1 on their answer document Ensure all test takers complete all components of the assessment

12. A list of all students to be assessed, gender and homeroom locator information List of the 6-digit answer document ID number of each student Copy to be sent to the WV Department of Education School keeps a copy for five years to use for the follow-up study Recommend including an email address for follow-up ease and/or identification of awards

13. Encourage all students to do their best. Promote the HSTW Award of Educational Achievement (407 WV students received this in 2008) Explain the new student readiness reports and how it can help with their resumes Build enthusiasm Be honest – explain how this helps the school and future students Make students feel special for participating in the assessment and thank them for their participation Recognize those who receive the HSTW Award of Educational Achievement 13 Make the 2010 Assessment a Success!

14. Communication Letters to students and their parents Announcements to faculty and staff Cooperation Importance of the assessment to the schools improvement goals Importance of students, administration and faculty taking it seriously Handling make-up work Cooperation from teachers whose classes might be interrupted by the assessment; set testing dates early! 14 Make the 2010 Assessment a Success!

15. Scheduling the Assessment Session(s) Select dates and makeup dates now, early in the test window Divide large numbers of students into several assessment groups Schedule at least two days for the assessment Find a location suitable for testing Select a time that does not conflict with other activities Notify students ahead of time To ensure your school receives a report, it is critical that all students complete all four components of the assessment.

16. Please DO NOT have students fill out this section of the assessment without direct adult guidance and supervision. It is strongly advised this section be filled out prior to test day.

17. Section 1 – Course History Student Survey for 2010 is shorter Strongly recommend schools complete Section 1 o More accurate o Reduces administration time 17

18. You will need: A copy of each students transcript Each students current schedule The Course Matching Chart Use the completed WV Course Matching Chart to match each course students have taken or are currently enrolled to the SREB course title The CTE Concentration Chart Use the completed WV Career/Technical Concentration Chart to determine the appropriate concentration for each student

19. Place order Order window September 1 – October 30, 2009 Orders must be placed online on SREB website WVDE will only order for the 21 st Century HSTW sites; all others will order directly from SREB All communication and materials will be sent to contact person listed on order form

20. Information needed to place order If your school has previously participated in an assessment Name, email address and phone number of contact person (will receive all materials and communication via mail and email) Complete shipping address (no P.O. boxes) Principal name, email address and phone number Sampling method and number of students to be assessed Payment information and billing address Dates the school plans to assess within window Number of teacher surveys needed

21. Payment Information For all regular HSTW sites paying for the assessment, a purchase order is due to SREB by October 30, 2009 to confirm your order (send copy to Marian Covey, WVDE) Final payment is due to SREB by April 30, 2010 SREB will accept payments beginning immediately (call Fran Mathis at 404-879- 5611 to request an early invoice)

22. Procedure for Checking Materials Check materials as soon as possible after they arrive Safeguard materials Save the boxes in which materials arrived Contact ETS immediately if Your counts do not match the totals given on the shipping notice You are missing any of the materials listed on the shipping notice You do not have enough books for all of your participating students; books come in packages of 10 Testing Materials

23. Procedure for assigning books Find the six-digit Student ID number located in the upper right corner of the answer document Assign the answer document to the first student by writing the students name on the answer document and by writing the six-digit Student ID number in column D of the Student Roster Form. Do not use labels on the answer document Complete the box under the student name with your schools name and state Be sure to write your site code number on the answer document and bubble in #

24. Students must complete Section 2 of student survey of Book 1 This section can be completed before testing begins (during academic advisory, homeroom, common core class, etc.) If this section is not completed, the students test will not be scored. The accuracy of the data on you instructional practices depends on student responses on this survey.

25. Assemble materials and set up the room Supervise student check-in Supervise the session using the administration scripts Collect the materials Schedule makeup sessions for students who are absent Administering the Assessment

26. The test administrator should have the following materials in the room Administration guide with script Completed student roster form Pre-assigned answer documents State ID number (WVEIS student ID number) No. 2 pencils with erasers Reliable watch or timer Scientific or graphing calculators for math session only Conducting the Assessment

27. Prohibited items in testing room Checking in students Verify each students name on the Student Roster Form Check to see that a 6-digit student ID number has been entered in Column D Note absent students in the proper column on the roster in pencil Defective Test Materials Conducting the Assessment

28. The test administrator may Answer student questions about procedures only, not content in math, science or reading Move about the room to see that students are following directions and working on the correct section Allow students to leave the room in emergency situations only Supervising the Assessment

29. Test Administration Irregularities Group irregularities Individual irregularities Test Administration Scripts Answer Document Information Supervising the Assessment

30. After each assessment session Collect and count the books and answer documents Complete the SCHOOL USE ONLY (Assessment Status Box) by filling in the appropriate code 1 - Completed book 2 - Absent 3 - Other Collecting the Materials

31. Verifying information on the answer documents Used and unused answer document and assessment materials return The Guide sent with your test materials will include these instructions. Packing and Returning Used Answer documents

32. Receive Testing Materials and Teacher Surveys from ETS By January 20, 2010 Administer the Assessment January 29-February 19, 2010 Ship materials back to ETS No Later Than February 19, 2010 Keep the receipt and tracking numbers Schools that return materials after the deadline will risk not receiving their results or awards!

33. Reading – focus on informational texts; 90 minutes; 80 percent informational texts; 20 percent literary nonfiction Mathematics – topics through Algebra II and some pre-calculus; 70 minutes; calculators permitted in two sections; no questions will advantage or disadvantage users of scientific vs. graphing calculators Science – life, physical and earth science; 70 minutes; 40 percent life science; 40 percent physical science; 20 percent earth and space science 33

34. Constructed response items carry more weight than multiple choice. Students should attempt all open-ended questions; even a response not showing mastery is likely to earn more points than a correctly answered multiple-choice question. No points are subtracted for answering multiple- choice questions incorrectly; guessing cannot lower a students score and may improve it!

35. 90 minutes 80 percent informational texts; 20 percent literary nonfiction Includes meaning vocabulary Includes paired texts (to assess critical analysis) Does not include literary fiction or poetry 35

36. Passage length: 500 to 1,500 words Cognitive targets 20 percent locate/recall 45 percent integrate/interpret 35 percent critique/evaluate 36

37. 70 minutes Calculators permitted for two sections No questions will advantage or disadvantage users of scientific vs. graphing calculators Topics Pre-algebra through pre-calculus 37

38. Content 10 percent - number properties and operations 30 percent - measurement/geometry 25 percent - data analysis, statistics and probability 35 percent - algebra 38

39. Cognitive Targets 25 percent - low complexity (recall routine procedures) 50 percent - moderate complexity (make connections within mathematics or between mathematics and the real world) 25 percent - high complexity (analyze a problem mathematically) 39

40. 70 minutes Content 40 percent - life science 40 percent - physical science 20 percent - earth and space science 40

41. Science Practices 60 percent Identifying science principles Using science principles 40 percent Using scientific inquiry Using technological design 41

42. Goal Assess a students ability to reason and think scientifically using general knowledge of matter, energy and motion in physical science Structures and functions of living systems and changes in living systems in life science Earth structures and systems in earth science 42

43. Teacher survey January 7 – February 5, 2008 Surveys have been ordered for entire teaching faculty at each site Technical centers are to survey their faculty Surveys documents, scan sheets and a return envelope for the completed scan sheets will be mailed from WVDE to sites in mid-to late December. Do not return the survey documents

44. Teacher survey Return the completed teacher survey scan sheets by February 5, 2008 to: Paula Staley State HSTW Coordinator WVDE 1900 Kanawha Blvd E, Bldg 6 Room 221 Charleston WV 25305

45. School-level report 3-minute report – One page including implementation summary; percent at each proficiency level; percent meeting readiness goals; quadrant for state data 30-minute report – Slightly longer summary including mean scores; proficiency levels; readiness goals; completion of recommended curriculum; indices 3-hour report – Tables breaking out achievement by experiences; teacher survey results 45

46. Individual Student Readiness Report Performance level on reading, mathematics and science tests Progress toward meeting the HSTW- Recommended Curriculum Progress toward completing a concentration (CT, humanities, mathematics/science) Award status for the HSTW Award of Educational Achievement Useful for résumés, college and job applications Will be mailed to schools by April 30, 2010 46

47. Reporting Comprehensive school-level report Individual student reports HSTW Award of Educational Achievement 47

51. Includes: Performance level on each subject test Progress towards meeting the HSTW curriculum goals Progress towards completing a concentration (CT, humanities, mathematics/science) Award status Useful for résumés, college applications, job applications Will mail to schools by April 30, 2010 51

53. Order window September 1 – October 30, 2009 Administration materials available online September 1, 2009 Test materials arrive at sites January 20, 2010 Student and teacher administration window January 29 – February 19, 2010 Final return deadline February 19, 2010 Awards and student reports mailed to sites April 30, 2010 Payment due to SREB April 30, 2010 School reports mailed to sites June 30, 2010

54. WVDE Marian Covey (304) 957-9833 ext. 53517 mecovey@access.k12.wv.us Paula Staley pstaley@access.k12.wv.us

55. Go to SREBs Web pages on assessment for more ideas and information! http://www.sreb.org/programs/hstw/Assessment/assessindex. asp **Please note SREB will be launching a new web site this fall. The assessment direct link will be different but the new website will be easier to navigate. Allison Timberlake, Director of Assessment and Evaluation allison.timberlake@sreb.org (404) 879-5575 Fran Mathis, Research Assistant fran.mathis@sreb.org (404) 879-5611