Assessment Services, SDUSD 2012 STAR Nuts & Bolts Grades 6-11 Traditional Calendar

2 Agenda New for 2012 Test Security Before Testing During Testing After Testing

3 What’s New for 2012? The testing window has been extended by 4 days Section A3 IEP504In Section A3 on the answer document, you must indicate IEP or 504 in subsection “a” even if the student did not use an accommodation or modification 12b 12c DO NOT COMPLETEThere are 2 new fields on the answer document: 12b SEID for ELA teacher and 12c SEID for Math teacher; DO NOT COMPLETE IGNORE 12b & 12c

4 What’s New for 2012? Mark discrimination analysisMark discrimination analysis– an automated process completed at the time of scanning to determine how many responses have been changed; results of the analysis are sent to the CDE leading to investigations at schools with excessive erasures Random security auditsRandom security audits The language regarding the “clean up” of answer booklets has been clarified- nothing within the response circle may be erased

Ensure that you and your staff NOT 1.Do NOT erase anything in the response circles NOT 2.Do NOT darken any marks in the response circles CLARIFICATION ON RESPONSE CIRCLES (BUBBLES) 5 What’s New for 2012?

6 Security Security Agreements Security Affidavits All materials must be kept in a CENTRAL, LOCKED, SECURE area In RED Envelope Agreements Nuts & Bolts BLM

7 Security Audits Possible visit from ETS/Global Compliance Service –Before –Before testing (pages in manual) –During –During testing (pages in manual) –After –After testing (pages in manual) –Ask for “official” letter from the representative when he/she comes to your school –Auditors will check that all materials are secure, accounted for, and when not in use locked up

8 Before Testing Identifying Students to Test? Accommodations & Modifications Receiving & Ordering Materials Preparing Materials & Locations Providing Training for Staff

9 Who should participate in the STAR Program? ALL ALL students in grades 2-11 except those exempt by parent or guardian Parent Exemption Request form in BLM Students participate in STAR by taking either the CSTs, CMA, or CAPA

STAR: Identifying Students California Standards Tests (CSTs) = grades 2-11; most students take CSTs California Modified Assessment (CMA)= grades 3-11; must meet SBE eligibility criteria; must be in IEP California Alternate Performance Assessment (CAPA) = grades 2-11; students with severe cognitive disabilities; must be in IEP STAR Item & Estimated Time Charts, pages in manual Page 76 in manual for CMA criteria See CMA & CAPA rosters

2011 STAR — Students Tested Statewide (English–Language Arts) 11

12 Identifying Tests for Non-CAPA Students: Required CST and CMA Tests at Each Grade Grade 6Grade 7Grade 8 Grade Level ELA CST or CMA Grade Level Math CST or CMA (not enrolled in Algebra) Grade Level Science CST or CMA Grade Level History-SS CST Content-Specific Math Algebra I CST or Algebra I CMA CST (Gen Math, Alg I, Geom, etc) or Algebra I CMA Geometry CMA STAR Item & Estimated Time Charts, pages in manual See Handout

13 Required Tests for CST/CMA Tests (non-CAPA students) Grade 9Grade 10Grade 11 Grade Level ELACST or CMA Grade Level Science CST or CMA Grade Level History-SS CST Content-Specific Math CST (Gen Math, Alg I, Geom, etc) or Algebra I CMA Geometry CMA CST (Algebra I, Geometry, HS Sum Math, etc) or Algebra I CMA Geometry CMA CST (Algebra I, Geometry, HS Sum Math, etc) or Algebra I CMA Geometry CMA Content-Specific Science CST (Biology, Physics, Chem, etc) Content-Specific History-SS World History CST See Attachments G, H, & I of Administrative Circular #54

14 Identifying Students for the Standards-based Tests in Spanish (STS) Eligibility Criteria 1.Spanish-speaking EL students enrolled less than 12 months in a US school 2.Spanish-speaking EL students receiving instruction in Spanish regardless of months enrolled see rosters and directions –Reading & Lang. Arts (Grades 2-11) –Grade Level Math (Grades 2-7) –Algebra 1 STS (Grades 7-11) –Geometry STS (Grades 8-11) Eligible students take the STS in addition to the CST and/or CMA (CAPA students do NOT take STS)

15 Special Education, 504 Students, and English Learners Identify “CAPA” & “CMA” students Review IEP and 504 Plans for accommodations & modifications that must be made available to students Plan for any variations that EL students will use during testing Identify English Learners who must take the STS See Attachment D of Administrative Circular # 54

16 Accommodation vs. Modification AccommodationsAccommodations –Change conditions for testing, but do not change what is being measured –Count as-is; no impact on API & AYP ModificationsModifications –Change testing conditions and what is being measured –Reported “as is” on the Student Report –Count as far below basic (200) for API –Do not count as proficient or as a participant for AYP

17 Modifications are NOT ALLOWED on the CMA See Attachment D of Administrative Circular # 54 Modifications are only allowed on CST & STS (if in 504 or IEP)

18 Receiving Materials SECURE ALL MATERIALS SECURE ALL MATERIALS ORDER ADDITIONAL MATERIALS INVENTORY UPON RECEIPT INVENTORY UPON RECEIPT Verify Quantity Note missing materials; contact Denise ASAP if there are discrepancies Fax Form Reseal Boxes Store in a SECURE, LOCKED area BLM S A V E B O X E S Count each booklet; packs of 20 don’t always contain 20

19 Identifying and Training Staff CST ExaminerCST Examiner = employee of SDUSD who has been trained and has signed a STAR Security Affidavit CMA ExaminerCMA Examiner = employee of SDUSD who has been trained and has signed a STAR Security Affidavit CAPA ExaminerCAPA Examiner = certificated employee of SDUSD who has received CAPA examiner training and has signed a STAR Security Affidavit STS ExaminerSTS Examiner = employee of SDUSD who has been trained, has signed a STAR Security Affidavit, and is bilingual in English and Spanish ProctorProctor = employee of SDUSD who has been trained and has signed a STAR Security Affidavit. See page 11 in manual

20 Required Training for Staff Ensure Consistency  Directions For Administration (DFA) must be read verbatim Ensure Test Security  Monitor students; actively supervise  Collect test booklets and answer documents before dismissing students  Ensure there is enough time to complete a part before beginning the part  Do not send unsupervised student(s) with test materials to alternate location  Report all irregularities/incidents ASAP See Handout

21 Required Training for Staff CANNOTTest Examiners CANNOT:  Review test questions before, during, or after testing  Leave instructional materials up in the classroom  Check students’ answers  Advise students of a wrong answer or advise student to check an answer  Withhold answer docs until students demonstrate they have the right answers  Divulge the contents of the test(s) to anyone Ensure that all examiners READ & UNDERSTAND the AFFIDAVIT

22 Prepare Testing Locations Create an ideal testing environment- free from noise with good lighting & ventilation Remove or cover all instructional materials visible to students related to the content of the test Make arrangements for students w/IEPs & 504s (i.e. read aloud) Prepare a separate room(s) for CMA test- takers Set up a quiet room where students who need more time to test can be escorted by an adult Arrange an activity and separate room for students not tested (exempt by parent)

23 Preparing & Distributing Materials Materials provided by school: –No. 2 pencils with erasers –“Testing- Do Not Disturb” signs –Scratch paper for math & science tests –Highlighters may be used (caution to grades 2 & 3) Make arrangements for students w/IEPs & 504s (i.e. Braille version, large-print, calculator, same version test for students with ”read aloud”, etc.) Page 66 in manual DAILYCheck materials out and in DAILY – see Inventory Control form; excel version on our website at BLM

24 During Testing Directions For Administration Required Fields on Answer Docs. Managing Emergency Situations Test Booklet Versions

25 CST, CMA, & STS Test Booklets- Multiple Versions Each grade level has multiple versions of the test Schools will receive only one version at grade 2 Schools will receive multiple versions for grades 3-11 For students who are eligible for the “read aloud” accommodation/modification, make sure you test with the same version when administering to a small group Students MUST hand-grid the version number used on the answer document Students MUST receive the same test version for the entire duration of the test CRITICAL

26 Directions For Administration (DFA) Grade 2 CST DFA is SECURE and cannot be distributed to teachers BEFORE testing; the nonsecure version may be used for training Additional DFAs may be downloaded at: “SAY” boxes must be read exactly as written “T” in “SAY” boxes indicates that everything in the box may be orally translated for EL students if regularly done in the classroom; can translate “SAY” boxes only and may not assist students with test questions

27 Managing Emergency Situations and Testing Incidents  Test administration incident  Test administration incident = any situation that occurs before, during, or after testing that does not conform to the instructions stated in the DFA or the coordinator’s manual Disruption in testing (fire alarm, power outage, evacuation) Test administration error (randomly distributing Pre- ID’d answer documents) Student cheating (mark A2, Special Conditions)  Complete a Test Administration Incident Report form RED  Make copy of report form for your files; send original in RED envelope to Assessment Services BLM Pages 65 and 82 in manual

28 Testing Irregularities  Testing irregularities  Testing irregularities = circumstances that may compromise the reliability and validity of test results; could negatively impact API and AYP Coaching students, leaving instructional material up during testing, allowing students to use additional materials not specified in the IEP/504, etc. Inappropriate test preparation Breach in security (i.e. copying tests)  Contact Erin Gordon ASAP Pages in manual

29 Answer Documents Pre-ID answer documents 2/07/12 will be included in your initial shipmentPre-ID answer documents = for students enrolled before 2/07/12; will be included in your initial shipment Pre-ID labels 2/07/12 4/05/12Pre-ID labels = for students enrolled between 2/07/12 and 4/05/12; pick up from Annex 10 after they arrive in the district (week of 4/16/12) Hand-grid blank answer documents 4/05/12first day of testing 4/06/124/12/12Hand-grid blank answer documents = students enrolled after 4/05/12 until the first day of testing; demo guides will be provided for students enrolled between 4/06/12 and 4/12/12

30 Answer Documents Answer Documents Continued separateThere are separate answer booklets/documents for CMA and CST at grades 3 and grades 8-11 changes hand-gridIf there have been changes since the pre-id file submission, a blank answer document must be hand-grid fields requiredThere are minimal fields required to match CMA and CST for students (grades 3 & 8-11) with one Pre-ID’d answer document who will be taking both a CST and CMA: 1.Name (last, first, and middle initial) 2.Birth date 3.Gender 4.Statewide Student Identifier (SSID)

31 CST/CMA Answer Docs - FRONT = Must Be Completed by HAND = Included in Pre-ID Students must use the correct answer document; check barcode label Sample answer document on page 130 in manual = Hand-grid ONLY if applicable Barcode Label ID IGNORE

32 CST Answer Documents- FRONT Box 7c = hand-grid for students taking the CMA = Must Be Completed by HAND Box 1 = completed by the student = Hand-grid ONLY if applicable

33 CST Answer Documents INSIDE For Content-Specific Math and Content- Specific Science the Math/Science CST or Math CMA taken MUST be hand-grid Version # must be hand-grid

34 Answer Documents Continued Early Assessment Program (EAP) Grade 11 ONLY To receive status for ELA, students must complete: –Writing essay in March; and –CST multiple choice questions; and –Additional EAP multiple choice questions. For mathematics, students must complete additional questions on the Algebra II CST or Summative High School Mathematics CST Students must mark ONLY ONE circle

35 Answer Documents Grade 7 CMA Math Grade 7 Math and Algebra I CMA have different numbers of questions

36 = Hand-grid ONLY if used by student = Hand-grid ONLY if applicable CST answer Documents - BACK = Included in Pre-ID

37 = Hand-grid ONLY if applicable CST Answer Documents - BACK Box A2: Special Condition codes on page 120 in manual (i.e. absent, parent exempt, cheated, refused to test) Box A1: only complete if directed by Erin (testing irregularities)

38 CST/CMA Answer Documents - BACK = Hand-grid ONLY if used by student Box A3b: Box A3b: hand-grid only if used by student; no modifications allowed on the CMA; codes on pages in manual Box A4: Box A4: hand- grid only if used by student; no glossary use allowed on ELA; codes on page 122 in manual = Hand-grid ONLY if applicable Box A3a Box A3a: must be completed for ALL students who have an IEP or 504

39 CAPA Answer Documents - FRONT = Must Be Completed by HAND = Included in Pre-ID Box 7a Box 7a = CAPA Level must be hand-grid Barcode Label ID IGNORE Box 4 Box 4 = Version # is 4 Sample answer document on page 140 in manual

40 CAPA Answer Documents - BACK = Hand-grid ONLY if used by student = Hand-grid ONLY if applicable = Included in Pre-ID = Must Be Completed by HAND

41 After Testing Prepare Answer Documents Complete Required Forms Pack Materials Properly Return Materials to Annex 10 Account for ALL Materials

42 Prepare SCORABLE Answer Documents 1.Check that the demographic information is complete & correct 2.Hand-grid A2, A3, & A4 if applicable 3.Check that version #s and math/science test taken has been completed (grades 7-11) 4.Check for tears, stray marks, pen marks 5.Check for paper clips, science reference sheets, scratch paper 6.Transcribe answers to clean answer document if original is damaged An answer document must be submitted for every student (grades 2-11) enrolled on the 1st day of testing

43 Grade 10 CST/CMA Grade 10 CAPA Grade 10 STS Prepare SCORABLE Answer Documents Continued GRADE 1.Separate all answer documents by GRADE TEST TYPE 2.Within each grade, separate by TEST TYPE (CST/CMA, CAPA, STS) EXEMPT ABSENT 3.Within each test type separate documents for students who were EXEMPT by parent (P on A2) and who were ABSENT (A on A2) for the entire test window = ABSENT = EXEMPT

44 Apportionment Form Complete one grade level at a time Indicate your school’s first day of testing Sign and have principal sign Return in RED envelope

45 Principal’s Certification Principal’s signature Return in RED envelope

46 School & Grade Identification (SGID)- side 1 grade test type Complete 1 SGID per grade level and test type: 1) CST/CMA; 2) CAPA; and 3) STS Hand-grid appropriate test Hand-grid grade level; leave blank for CAPA Number of answer docs. under this SGID Pages 26 & 93 in manual First day of testing When was STS given? If no STS, leave blank

47 School & Grade Identification (SGID)- side 2 Complete top ONLY for grades 2-8 Pages in manual for coding instructional materials Teacher Reports are no longer available, so don’t complete bottom portion

48 Master File Sheet SCORABLE Submit with SCORABLE materials- Box 1 For CAPA = all grades and levels are stacked together under 1 SGID Page 95 in manual Totals

scorables The Master File Sheet should be the first thing we see when we open Box #1 of your scorables 49

50 Packing Scorable Materials Master File Sheet on Top SGID on top of each stack of answer docs SCORABLE SCORABLE materials returned ORANGE in ORANGE labeled boxes Packing Order = 1.CAPA 2.CST/CMA (lowest grade level on top) 3.STS (lowest grade level on top) See pages in manual

51 Preparing Non-Scorable Materials D a m a g e d - t r a n s c r i b e d VOID answer documents if: Student transferred to a different school before your first day of testing Demographic information on PreID was incorrect & blank document was used Original answer document was damaged and transcribed to new answer document VOIDED answer documents go in NON-SCORABLES

52 Packing NON- Scorable Materials NON-SCORABLE Materials Return in GREEN labeled boxes Unused Freight Kit Materials USED Scratch Paper (return or securely destroy) CAPA Unused CAPA Answer Docs VOIDED Answer Documents Examiner’s Manuals & Tests CSTs/CMA (by grade level) DFAs Unused & VOIDED Answer Documents Test Booklets STS (lowest grade on top; highest grade on bottom) DFAs Unused & VOIDED Answer Documents Test Booklets Page in manual TOP BOTTOM

53 Returning Materials: Labeling Boxes Affix label to designated area on box Put box counts in SCHOOL section on labels

54 CORRECT WAY TO NUMBER BOXES WRONG WAY TO NUMBER BOXES COUNT SCORABLE BOXES SEPARATELY FROM NONSCORABLE BOXES

Lightly seal boxes to transport 55

56 RED Envelope 1.Signed Apportionment Form 2.Signed Certification Form 3.Signed Security Affidavits 4.Incident Reports Make copies for your files and submit originals Do not pack RED envelope in scorable and nonscorable boxes; keep separate

Return your materials to Annex 10 by 4:30 p.m. on your assigned day Traditional School Deadlines: May 15: G-M (Elem & Middle) May 16: N-Z (Elem & Middle) May 17: A-F (Elem & Middle) May 18: Senior High Schools 57

58 Contact Information Assessment Services Erin Gordon (619) ; Denise Ormsbee (619) ; Fax Number (619) Website: Special Education Sarah Ott (619) Julie Wade (619) Debby Warner (619) CAPA CMA CAPA