1. Welcome to... Before we begin, please make yourself comfortable and complete the STAR Pre-Test Quiz

2. PALM SPRINGS UNIFIED SCHOOL DISTRICT 2010 STAR Pre-Test Workshop Secondary Schools February 16, 2010 Educational Services Training Room

3. Testing Schedules Tests Test Dates Pick Up Dates 7 th Grade Writing 3/2/10 3/3/10 Make-ups 3/4/10 Warehouse pick up EAP Writing 3/2/10 – 3/31/10 4/1/10 Warehouse pick up Multiple- Choice 4/19/10 – 5/13/10 Oversight Dates 5/17/10 & 5/18/10

4. 2010 STAR Pre-Test Workshop || Slide 4 Objectives STAR coordinators will: Follow correct, current STAR proceduresFollow correct, current STAR procedures Ensure all materials are handled securely and appropriatelyEnsure all materials are handled securely and appropriately Provide training and monitoringProvide training and monitoring

5. Agenda Registration and Take QuizRegistration and Take Quiz New for STAR 2010New for STAR 2010 STAR Coordinator ResponsibilitiesSTAR Coordinator Responsibilities Writing TestsWriting Tests California Standards Tests (CSTs)California Standards Tests (CSTs) Early Assessment Program (EAP) TestsEarly Assessment Program (EAP) Tests California Modified Assessment (CMA)California Modified Assessment (CMA) Standards-based Tests in Spanish (STS)Standards-based Tests in Spanish (STS) Multiple-Choice TestsMultiple-Choice Tests California Alternate Performance Assessment (CAPA)California Alternate Performance Assessment (CAPA) After TestingAfter Testing Questions & AnswersQuestions & Answers 2010 STAR Pre-Test Workshop || Slide 5

6. STAR Site Coordinators January 2009 http://www.mavricmedia.com/startest/displayimage.php?album =23&pos=9 2010 STAR Pre-Test Workshop || Slide 6

7. New for STAR 2010 Overview No 2010 STAR Pre-Test Videos (http://www.mavricmedia.com/startest)No 2010 STAR Pre-Test Videos (http://www.mavricmedia.com/startest)http://www.mavricmedia.com/startest No audio CDsNo audio CDs Changes to answer documents or test bookletsChanges to answer documents or test booklets –Separate CMA answer documents for grades 8–11 –Section 7c, “Assessed with CMA” –Sections 8 and 9, “Ethnicity/Race” –Version numbers on second and third pages Additional CMA testsAdditional CMA tests –CMA for English–Language Arts (ELA) in grade 9 –CMA for Life Science in grade 10 –CMA for Algebra I in grades 7–11 Coordinator Manual (M) Page 2 2010 STAR Pre-Test Workshop || Slide 7

8. No updated videos; no DVDs distributedNo updated videos; no DVDs distributed “2010 STAR and CAPA” video access Web page at http://www.mavricmedia.com/startest“2010 STAR and CAPA” video access Web page at http://www.mavricmedia.com/startest http://www.mavricmedia.com/startest –Includes Introduction, Site, and Examiner Update documents 2010 STAR Pre-Test Workshop || Slide 8 New for STAR 2010 Videos 2010

9. New for STAR 2010 Changes to answer documents or test bookletsChanges to answer documents or test booklets –Separate CMA answer documents for grades 8–11 –Students taking one or more CMA tests will need to return a CMA AND a CST answer document –Section 7c, “Assessed with CMA” Students in grades 4–7 taking a CMA must complete Section 7cStudents in grades 4–7 taking a CMA must complete Section 7c For grades 8–11, staff mustFor grades 8–11, staff must complete Section 7c on the CST complete Section 7c on the CST for each of the CMA taken for each of the CMA taken M 2 2010 STAR Pre-Test Workshop || Slide 9 Quiz (Q) #1

10. Answer Documents 2010 GRADECSTCMA 2N/A 3Separate Separate / return both 4- 7 Combined 8 - 11 Separate Separate / return both Students taking the CMA in grades eight through eleven will receive a separate CMA answer document. Return both answer documents for CMA students. Mark section 7C on CST Answer Document/Test Booklet. M 2, 12 2010 STAR Pre-Test Workshop || Slide 10

11. New for STAR 2010 Changes to answer documents or test bookletsChanges to answer documents or test booklets –Sections 8 and 9, “Ethnicity/Race” Make sure that students mark only one circle in Section 8.Make sure that students mark only one circle in Section 8. Make sure students mark at least one circle in Section 9.Make sure students mark at least one circle in Section 9. M 2, 112 2010 STAR Pre-Test Workshop || Slide 11 Q 2

12. New for STAR 2010 Changes to answer documents or test bookletsChanges to answer documents or test booklets –Version numbers on second and third pages M 2 2010 STAR Pre-Test Workshop || Slide 12

13. STAR Site Coordinator Responsibilities Handle testing materialsHandle testing materials –Ensure test security –Receive, inventory, store, distribute, track, collect, and return materials Prevent errorsPrevent errors Verify materials are marked correctly to ensure correct student scoresVerify materials are marked correctly to ensure correct student scores Return materials promptlyReturn materials promptly 2010 STAR Pre-Test Workshop || Slide 13 M 54

14. Writing Tests CST and CMACST and CMA ONLY Grade 7ONLY Grade 7 Give correct test (CST or CMA) See bottom of response booklet and DFAGive correct test (CST or CMA) See bottom of response booklet and DFA M 31, 52 2010 STAR Pre-Test Workshop || Slide 14 Q 4

15. Writing Tests When?When? –March 2 (makeup March 3) –May 4 (makeup May 5) Only if not in session March 2 2010 STAR Pre-Test Workshop || Slide 15

16. After Writing Testing If the student used a word processor:If the student used a word processor: –Mark A3, “Accommodations and Modifications,” D or T –If A3 is not marked, the test will not be processed Return all materials with either the scorables or nonscorablesReturn all materials with either the scorables or nonscorables Return byReturn by –Sites: one day after testing –Districts: two days after testing 2010 STAR Pre-Test Workshop || Slide 16 Q 5 M 34, 56

17. Writing Test January 2009 http://www.mavricmedia.com/startest/displayimage.php?album =23&pos=11 2010 STAR Pre-Test Workshop || Slide 17

18. STAR Program Multiple-Choice Tests CSTsCSTs –Most students take CSTs –Grades 2–11 unless taking CMA or CAPA CMACMA –Grades 3–11; varies by grade and content area –Must have IEP and meet eligibility criteria STSSTS –For Spanish-speaking English learners –Grades 2–11 –Must also take CST and/or CMA 2010 STAR Pre-Test Workshop || Slide 18 Q 6 M 4, 36

19. California Standards Tests (CSTs) Grades 2–11 for most studentsGrades 2–11 for most students Unless taking CMA or CAPAUnless taking CMA or CAPA Subjects tested:Subjects tested: –English–Language Arts: all grades –Mathematics: grades 2–7 and end-of-course (EOC) 7–11 –Science: grades 5, 8, 10, and EOC 9–11 –History–Social Science: grades 8, 11, and EOC 9–11 See “Allowable Test Variations, Accommodations and Modifications” at http://www.cde.ca.gov/ta/tg/saSee “Allowable Test Variations, Accommodations and Modifications” at http://www.cde.ca.gov/ta/tg/sa 2010 STAR Pre-Test Workshop || Slide 19 M 4, 36, 83

20. Who Takes Which CST for Mathematics? 2010 STAR Pre-Test Workshop || Slide 20 Grades 2–6: Grade-level test required Grade 7: Grade 7 math test or Algebra I required Grades 8–9: One of the following is required:  EOC CST for Mathematics; or  CST for Summative High School Mathematics (grade 9 only); or  CST for General Mathematics (if no math course or completing a course for which there is not an EOC CST for Mathematics) Grades 10–11: One of the following is required:  EOC CST for Mathematics; or  CST for Summative High School Mathematics  No assessment required if not taking a mathematics course Q 7 M 16, 81

21. CST High School January 2009 http://www.mavricmedia.com/startest/displayimage.php?albu m=23&pos=3 2010 STAR Pre-Test Workshop || Slide 21

22. Summative High School Mathematics Students in grades 9–11 will take the CST for Summative High School Mathematics if: –Previously completed Algebra I, Algebra II and Geometry courses (or Integrated Mathematics 3), and completing an advanced mathematics course this year; or –Previously completed Algebra I, Algebra II and Geometry courses (or Integrated Mathematics 3), and are taking no mathematics course this year; or –Previously took the CST for Summative High School Mathematics. 2010 STAR Pre-Test Workshop || Slide 22 M 16, 81

23. CST for Science Required grade-level scienceRequired grade-level science –Grades 5, 8, 10: all students take grade-level test Grades 9–11 EOCGrades 9–11 EOC –Based on standards-based science course completed during the school year or the previous summer, whichever is more recent –If more than one standards-based science taken, which test taken determined by district Mark correct EOC test and version number on answer documentMark correct EOC test and version number on answer document 2010 STAR Pre-Test Workshop || Slide 23 Q 8 M 17, 82

24. Early Assessment Program 2010 STAR Pre-Test Workshop || Slide 24

25. 2010 STAR Pre-Test Workshop || Slide 25

26. Grade 11 ONLYGrade 11 ONLY To receive status for ELA, students must complete:To receive status for ELA, students must complete: –Writing essay in March; and –CST multiple choice questions; and –Additional EAP multiple choice questions. For mathematics, students must complete additional questions on the EOC Algebra II or Summative High School MathematicsFor mathematics, students must complete additional questions on the EOC Algebra II or Summative High School Mathematics Students must mark ONLY ONE circleStudents must mark ONLY ONE circle Early Assessment Program M 4, 36 2010 STAR Pre-Test Workshop || Slide 26

27. 2010 STAR Pre-Test Workshop || Slide 27

28. 2010 STAR Pre-Test Workshop || Slide 28

29. CMA Tests for 2010 CMA for ELA in grades 3–9 (added grade 9)CMA for ELA in grades 3–9 (added grade 9) –CMA for Writing in grade 7 CMA for Mathematics in grades 3–7CMA for Mathematics in grades 3–7 CMA for Algebra I (EOC for grades 7–11) (new)CMA for Algebra I (EOC for grades 7–11) (new) CMA for Science in grades 5 and 8CMA for Science in grades 5 and 8 CMA for Life Science in grade 10 (new)CMA for Life Science in grade 10 (new) December 2009 M 4, 14, 72 2010 STAR Pre-Test Workshop || Slide 29

30. CMA Tests for 2011 CMA for ELA in grades 3–11CMA for ELA in grades 3–11 (add grades 10 and 11) (add grades 10 and 11) CMA for Mathematics in grades 3–7CMA for Mathematics in grades 3–7 CMA for Algebra I (EOC for grades 7–11)CMA for Algebra I (EOC for grades 7–11) CMA for Geometry (EOC for grades 8–11) (new)CMA for Geometry (EOC for grades 8–11) (new) CMA for Science in grades 5 and 8CMA for Science in grades 5 and 8 CMA for Life Science in grade 10CMA for Life Science in grade 10 December 2009 2010 STAR Pre-Test Workshop || Slide 30

31. Who Takes CMA? Students:Students: –Have an IEP –Meet the SBE-adopted eligibility criteria –Enrolled in grades 3–11 –May take CMA for some subjects, CST for other subjects –Must take grade-level CSTs when a CMA is not offered –May have previously taken CMA, regardless of score –Not eligible to take CAPA IEP specifies CMA and subject(s)IEP specifies CMA and subject(s) No modificationsNo modifications Allowable Testing Variations and Accommodations for the 2010 CMA is available on the STAR Web site at http://www.startest.org/pdfs/CMA.acc_table.2010.docAllowable Testing Variations and Accommodations for the 2010 CMA is available on the STAR Web site at http://www.startest.org/pdfs/CMA.acc_table.2010.doc 2010 STAR Pre-Test Workshop || Slide 31 M 14, 72, 89

32. CMA Materials for 2010 CMA for Grades 4–7CMA for Grades 4–7  CST and CMA in same answer document CST answer documentsCST answer documents  7c for CMA tests taken CMA for Grades 8–11CMA for Grades 8–11 –Separate answer documents and test booklets –Must return CST answer document (all students will take one or more grade- level CSTs or EOC in either EOC mathematics, science, and/or history–social science) –Single DFA covers 9–11 2010 STAR Pre-Test Workshop || Slide 32 Q 10

33. CST/CMA Answer Document Right inside CMA section has: Different subject icons from CST Alternate row shading for the response bubbles Three answer choices Fewer number of questions 2010 STAR Pre-Test Workshop || Slide 33

34. CMA Grade 7 Mathematics Answer Document Grade 7 math and Algebra I have different numbers of questions

35. 2010 STAR Pre-Test Workshop || Slide 35 CMA Middle School http://www.mavricmedia.com/startest/displayimage.ph p?album=23&pos=8

36. STS STS for Reading/Language Arts (RLA) in grades 2–11STS for Reading/Language Arts (RLA) in grades 2–11 STS for Mathematics in grades 2–7STS for Mathematics in grades 2–7 STS for Algebra I (EOC for grades 7–11)STS for Algebra I (EOC for grades 7–11) –If Algebra I course completed in 2009-10 school year STS for Geometry (EOC for grades 8–11)STS for Geometry (EOC for grades 8–11)  If Geometry course completed in 2009-10 school year Students in grades 8 and 9 who are not taking Algebra I or Geometry courses take NO STS math, but do take CST math. 2010 STAR Pre-Test Workshop || Slide 36 M 4, 15, 17

37. Who Takes the STS? Required for Spanish-speaking English learners (EL), grades 2–11, who either:Required for Spanish-speaking English learners (EL), grades 2–11, who either: –Receive instruction in Spanish; or –Have been enrolled in a school in the U.S. less than 12 cumulative months. Not to be administered to English-only, I-FEP, or R-FEP studentsNot to be administered to English-only, I-FEP, or R-FEP students 2010 STAR Pre-Test Workshop || Slide 37 M 4, 15 Q 11

38. STS and EL Variations While English Learner Test Variations are available to ELs, they are NOT to be applied to the STS.While English Learner Test Variations are available to ELs, they are NOT to be applied to the STS. –page 20, paragraph 1of the DC manual : “Matrix 2 includes variations available for testing English learners on the CSTs and the CMA—there are no English learner test variations for students taking the STS because those tests are administered in Spanish.” M 20 2010 STAR Pre-Test Workshop || Slide 38

39. January 2009 STS Middle School http://www.mavricmedia.com/startest/displayimage. php?album=23&pos=2 http://www.mavricmedia.com/startest/displayimage. php?album=23&pos=2 http://www.mavricmedia.com/startest/displayimage. php?album=23&pos=2 http://www.mavricmedia.com/startest/displayimage. php?album=23&pos=2 2010 STAR Pre-Test Workshop || Slide 39

40. Receive delivery Dist. 10–20 days before testing School 5–10 days before testing Test Return for scoring Dist. 5 days after testing School 2 days after testing Train Multiple-Choice Tests Inventory Prepare materials Distribute and track materials Ensure correct Master File and SGID Pack with complete labels 2010 STAR Pre-Test Workshop || Slide 40

41. Before Multiple-Choice Testing Answer Documents Use 2010 answer documents onlyUse 2010 answer documents only Do NOT copy answer documentsDo NOT copy answer documents Complete Sections 8 and 9 if not in Pre-IDComplete Sections 8 and 9 if not in Pre-ID Make sure that students mark only one circle in Section 8.Make sure that students mark only one circle in Section 8. Make sure students mark at least one circle in Section 9.Make sure students mark at least one circle in Section 9. 2010 STAR Pre-Test Workshop || Slide 41 M 36, 58

42. During Multiple-Choice Testing Use Directions for Administration (DFAs) correctlyUse Directions for Administration (DFAs) correctly –Read “SAY” boxes exactly as written –Translate boxes with “T” ONLY (NO questions, prompts, or passages) passages) 2010 STAR Pre-Test Workshop || Slide 42 M 50

43. During Multiple-Choice Testing Give correct test booklets and answer documents to students (e.g. grade 7 math or Algebra I to grade 7)Give correct test booklets and answer documents to students (e.g. grade 7 math or Algebra I to grade 7) Give breaks only at end of partGive breaks only at end of part Answer documentsAnswer documents –Section 7c for CMA tests taken –Correctly mark Test –Correctly mark Version # 2010 STAR Pre-Test Workshop || Slide 43 Q 1, 13 M 50

44. After Multiple-Choice Testing Complete Back of Answer Document A1A1 –DO NOT complete without CDE notification A2 Special ConditionsA2 Special Conditions –“All tests” column removed A3 Accommodations and ModificationsA3 Accommodations and Modifications –“All tests” column removed – “P” student used an audio CD presentation has been removed A4 English Learner Test VariationsA4 English Learner Test Variations –No change 2010 STAR Pre-Test Workshop || Slide 44 M 34, 63

45. Performance-based, one-on-one testPerformance-based, one-on-one test Student must have an IEPStudent must have an IEP IEP specifies CAPA and LevelIEP specifies CAPA and Level For students with significant cognitive disabilities unable to take the CSTs even with accommodations and/or modifications or the CMA with accommodationsFor students with significant cognitive disabilities unable to take the CSTs even with accommodations and/or modifications or the CMA with accommodations Do not take STSDo not take STS Answer document if not in Pre-ID:Answer document if not in Pre-ID: –Ensure correct CAPA Level is marked in 7a CAPA 2010 STAR Pre-Test Workshop || Slide 45 M 14 Q 9

46. CAPA Observers Districts must double rate at a minimum of (10%) of the CAPA students per level/per siteDistricts must double rate at a minimum of (10%) of the CAPA students per level/per site Double ratings are randomly selectedDouble ratings are randomly selected Observers must mark Observer and sign the answer documentObservers must mark Observer and sign the answer document Examiner uses Pre-ID answer documentExaminer uses Pre-ID answer document Observer uses blank answer documentObserver uses blank answer document 2010 STAR Pre-Test Workshop || Slide 46 Q 14 M 48

47. January 2010 Observers must mark sections 1 - Name, etc. 3 - Date of Birth 5 - Name 6 - Gender 7a - CAPA Level 7b - Grade 11 - Student ID 12 - SSID Preparing To Administer the CAPA 2010 STAR Pre-Test Workshop || Slide 47

48. January 2009 CAPA http://www.mavricmedia.com/startest/displayimage. php?album=23&pos=6 http://www.mavricmedia.com/startest/displayimage. php?album=23&pos=6 http://www.mavricmedia.com/startest/displayimage. php?album=23&pos=6 http://www.mavricmedia.com/startest/displayimage. php?album=23&pos=6 2010 STAR Pre-Test Workshop || Slide 48

49. After Testing Transcribe Braille and large print (or not processed)Transcribe Braille and large print (or not processed) Write VOID on any answer document(s), with marks, not to be scored; return with nonscorablesWrite VOID on any answer document(s), with marks, not to be scored; return with nonscorables 2010 STAR Pre-Test Workshop || Slide 49 Q 15 M 40, 55, 57, 63

50. After Testing Master File Sheets Return with each school and districtReturn with each school and district Required:Required: –Write “0” (zero), no blanks –If not tested, note that school did not test 2010 STAR Pre-Test Workshop || Slide 50 Q 16 M 64, 93

51. After Testing Pack and Return Return all documents within an administration in same shipmentReturn all documents within an administration in same shipment Separate scorables (with SGID) from nonscorablesSeparate scorables (with SGID) from nonscorables Return Home/Hospital with student’s schoolReturn Home/Hospital with student’s school 2010 STAR Pre-Test Workshop || Slide 51 M 40, 64

52. Complete Labels Correctly Both district and school counts required 2010 STAR Pre-Test Workshop || Slide 52 Q 17 Do NOT mark here!!!

53. Item and Estimated Time ChartsItem and Estimated Time Charts –CST, CMA, CAPA, STS: untimed CST, CMA, CAPA, STSCST, CMA, CAPA, STS –Administered during same testing window CST and CMA WritingCST and CMA Writing –Tests administered on specific date only CAPACAPA –Allow time to assemble manipulatives –Start testing early in testing window. Scheduling

56. Scheduling Considerations & Best Practices! Promote positive attitudesPromote positive attitudes Middle of the weekMiddle of the week Avoid days before/after vacations or important school functionsAvoid days before/after vacations or important school functions Mornings generally recommendedMornings generally recommended

57. Scheduling Considerations & Best Practices! One test session per day bestOne test session per day best –Consider the rigor of the testing sessions Provide for all test variationsProvide for all test variations –Test examiners must know what will be provided and to which students –Plan for the individual and small-group testing Make use of all site and district staffMake use of all site and district staff

58. Scheduling Considerations & Best Practices! Testing all grade level/subject area students at the same time during the same day bestTesting all grade level/subject area students at the same time during the same day best Same teacher/same seat bestSame teacher/same seat best Schedule the time for make-upsSchedule the time for make-ups

59. Scheduling Considerations & Best Practices! What will reduce anxiety in teachers and studentsWhat will reduce anxiety in teachers and students Schedule around the testSchedule around the test –How can noise disruption be avoided How will make-up testing be as effective as during the regular scheduleHow will make-up testing be as effective as during the regular schedule

60. Test Parts Each subject of the CST and CMA is divided into “parts.” Each part must be administered in a single sitting.Each subject of the CST and CMA is divided into “parts.” Each part must be administered in a single sitting. CST test parts SHOULD be administered contiguously without another test interrupting.CST test parts SHOULD be administered contiguously without another test interrupting. Refer to your Coordinator’s Challenge matrix to be certain that you have scheduled all parts of all tests.Refer to your Coordinator’s Challenge matrix to be certain that you have scheduled all parts of all tests. CST Times Estimates of the time required by most studentsEstimates of the time required by most students Plan for students who might run over on CSTs or CMA.Plan for students who might run over on CSTs or CMA.

61. Coordinator’s Challenge SecuritySecurity CommunicationCommunication Quality ControlQuality Control CommunicationCommunication Positive Test EnvironmentPositive Test Environment CommunicationCommunication SecuritySecurity

62. District Accuracy Check and Pack-up Plan To increase the accuracy of our data by increased Oversight without increasing costs to the district or reducing quality of testing at the sites.To increase the accuracy of our data by increased Oversight without increasing costs to the district or reducing quality of testing at the sites. Finalize Oversight review at the sites (vs. centrally) and utilize all of Educational Services to inspect answer documents.Finalize Oversight review at the sites (vs. centrally) and utilize all of Educational Services to inspect answer documents. This will streamline the process, allowing for 19 testing days while achieving our data accuracy goal.This will streamline the process, allowing for 19 testing days while achieving our data accuracy goal.

63. District Accuracy Check and Pack-up Plan (Con’t) Sites will be required to organize student answer documents for ease of Oversight review (Assessment Division will distribute all procedures, timeframes, etc. to support new processes).Sites will be required to organize student answer documents for ease of Oversight review (Assessment Division will distribute all procedures, timeframes, etc. to support new processes). Sites will be required to provide resources to perform Zangle look-ups for missing student data.Sites will be required to provide resources to perform Zangle look-ups for missing student data.

64. District Accuracy Check and Pack-up Plan (Con’t) District Office personnel will be trained in all requirements of the Oversight procedure, and they will be provided with an inspection checklist.District Office personnel will be trained in all requirements of the Oversight procedure, and they will be provided with an inspection checklist. Upon completion and sign-off of Oversight at the site, the inspection and packaging of materials will be complete and ready for pickup and delivery directly to the PSUSD warehouse.Upon completion and sign-off of Oversight at the site, the inspection and packaging of materials will be complete and ready for pickup and delivery directly to the PSUSD warehouse.

65. Questions and Answers 2010 STAR Pre-Test Workshop || Slide 65

66. Thank you!!! 2010 STAR Pre-Test Workshop || Slide 66