2012 Standardized Testing and Reporting (STAR) Program Multiple Choice Tests Pre-Test Workshop for Test Site Coordinators Middle and K-8 schools Session One: 3:30-5:30 PM Wednesday, 2/15/12–Montana Room Session Two: 9:00-11:00 AM Thursday, 2/16/12–Montana Room Presented by: Mao J. Vang, Ed.D. Sacramento City Unified School District Assessment, Research and Evaluation, Box – 47 th Ave. Sacramento, CA Tel Fax

Agenda Introductions Objectives New in 2012 Test Security STAR Program Overview Test Site Coordinator Responsibilities – Multiple Choice Tests Documents and Coding Test Variations, Accommodations & Modifications Preparing Documents for Return Additional Resources Questions & Answers 2

Objectives Provide an overview, key requirements, and administration information for the 2012 Standardized Testing and Reporting (STAR) Program Present the requirements for ensuring test security Review required student demographic information Preview required forms and how to complete them Review how to package and return all testing materials Visit Training Resources for Test Site Coordinators Webpage 3

Key Dates 4 STARGradeTesting WindowMaterials DeliveryMaterials Pickup Writing Tests CST & CMA Writing Standards Tests 4 & 7 March 6 (Make-up March 7) All schools with grades 4 and 7 February 27-March 2March 8-9 Multiple-Choice Tests CST CMA CAPA STS 2-11 Wave 1: March 27-May 3, 2012 New Technology & Nonpublic Schools March 19-23May 7-11 Wave 2: April 18-May 18, 2012 Traditional Calendar Schools, The Language Academy, & Yav Pem Suab Academy April 9-13May Test materials must be ready for pick-up by 8:00 AM on the specific date(s) for pick-up. If you complete testing ahead of schedule, contact AR&E to arrange for early pickup.

New for 2012 Testing window: 23 days Answer documents – Front: SEID added – Back: NPS moved – CAPA (shading of “5”) for Level I ONLY Writing tests – Reading aloud prompt now accommodation – Writing test can only be given in 1 d ay CMA – Braille for all – Grades 8–11 if Pre-ID, receive both CST and CMA Pre-ID answer documents 5

New for 2012 District home, hospital, independent study has a school code – If district has a program – Use new district CDS code calpadsupdflash41.doc Security Audits Mark Discrimination Analysis 6

STAR Program Overview California Standards Tests (CST) Grades 2-11 for most students, includes separate writing test in grades 4 & 7 California Modified Assessment (CMA) Grades 3-11 for students with IEP specification, includes separate writing test in grades 4 & 7 California Alternate Performance Assessment (CAPA) for students with significant cognitive disabilities Standards-based Tests in Spanish (STS) English learners grades 2-11 whose primary language is Spanish and: – Receive instruction in Spanish, or – Have been enrolled in US school < 12 months 7

Testing Requirements All students enrolled on the first day of testing for each district in grades 2-11 needs to be assessed with one of the following: – CST/CMA – CAPA 8

Testing Requirements by CST Content 9 California Standards Test Grade English Language Arts Mathematics (Choose one end-of-course (EOC) completed in summer 2011 or will complete in school year) Science Grade 8 History-Social Science Grade 8 Grade-level MathGeneral MathAlgebra IGeometry 7 Required + separate Writing Test Required if not in Algebra I or higher math N/AEOCN/A 8 RequiredN/A Required if not in Algebra I or higher math EOC Required

Testing Requirements by CMA Content 10 California Modified Assessment GradeEnglish Language Arts Mathematics (Choose one end-of-course (EOC) completed in summer 2011 or will complete in school year) Science Algebra IGeometryScience Grade 8 7Available+separate Writing TestAvailableN/A 8Available Note: If current Individual Education Plan (IEP) specifies CMA content area for a student, the student does not take that corresponding part on the CST.

CMA Participation Current IEP specifying CMA & content area(s) Previous participation – Previous CST Score of FBB or BB in subject area assessed and may have taken the CST with modifications; and – 2 years scoring Proficient or Advanced on CAPA Not be eligible to take the California Alternate Performance Assessment (CAPA). Response to appropriate instruction – Receiving grade level instruction and has goals written to grade level standards 11

Testing Requirements by CAPA Content 12 Note: If current Individual Education Plan (IEP) specifies CAPA for a student, the student takes CAPA for all content areas. California Alternate Performance Assessment LevelGrades English Language Arts MathematicsScience I2-11Required II2-3Required III4-5Required IV6-8Required V9-11Required

Performance-based, one-on-one test For students with significant cognitive disabilities unable to take the CSTs even with accommodations and/or modifications or the CMA with accommodations Student must have an IEP IEP specifies CAPA and level Do not take STS Answer document: – Use only 2012 answer document – Ensure correct CAPA Level is marked in 7a CAPA Overview 13

CAPA Overview Continued CAPA is to be administered by trained licensed or certificated individuals 10% of the CAPA tests by level must be second rated CAPA testing window is the same as the multiple-choice window. CAPA materials are include with multiple-choice materials. For questions regarding training for CAPA examiners, contact: – Linda Kawahara-Matsuo, District CAPA trainer – Special Education Department –

CAPA Observers Districts must double-rate at a minimum of ten percent (10%) of the CAPA students per level, per site (including NPS) Double ratings are randomly selected Observers must mark Observer and BOTH examiners and observers must sign the answer document 15

Preparing To Administer the CAPA Observer’s Answer Doc 1 – Name, etc. 3 – Date of Birth 5 – Name 6 – Gender 7a – CAPA Level 7b – Grade 11 – Student ID 12a – SSID Use blank from overage. Observers must mark sections 16

Testing Requirements by STS Content 17 Standards-based Tests in Spanish GradeEnglish Language Arts Mathematics (Algebra I and Geometry are available for grades 8-11) 2Available Available 11Available Note: Students in grades 8 who are not taking Algebra I or Geometry courses take NO STS math, but do take CST math.

STS Overview Required for English learners (ELs) in grades 2-11 whose primary language is Spanish and who either: – Receive instruction in Spanish regardless of the length of time they have been enrolled in the U.S.; or – Have been enrolled in a school in the U.S. less than 12 cumulative months. Not to be administered to English-only, I-FEP, R-FEP, or dual immersion who do not meet the inclusion criteria stated. Students taking the STS must also take CSTs or the CMA Students who take CAPA do NOT take STS 18

Site Coordinator Segment – General, first part about security only – Refer to Site Coordinator Updates for 2012 Handout View Training Video 19

Security Documents The STAR Security Agreements from STAR test site coordinators (principals) MUST be received by AR&E before test materials may be delivered to test sites. – Principals must review and sign the 2012 STAR Test Security Agreement and send it to STAR test site coordinators MUST have a completed 2012 STAR Test Security Affidavit from test examiners before giving them testing materials. 20

Test Security Agreement and Affidavit Send copies of all Test Security and Affidavits to city.k12.ca.us or city.k12.ca.us Box 780 by first day of multiple choice testing. Sign by all others having access to STAR Tests Sign by Principal or Designated Test Site Coordinator 21

Security Audits At randomly-selected schools and district offices Before, during, or after testing Are materials secure, accounted for, and when not in use locked-up Are correct administrative procedures being followed: – Materials have been removed or covered – Students are not being coached through the exams – Only appropriate accommodations and or modifications are being provided, et. al. 22

Mark Discrimination Analysis An automated process completed at the time of test booklet (grades two and three) and answer document scanning Identifies erasures to determine if the response has changed from: – Correct to wrong, or – Wrong to wrong, or – Wrong to correct, or From the analyses a report is produced and forward to the CDE who in turn requests districts to conduct an investigation based on the analyses  Wrong left wrong, or  Correct left correct, or  No response 23

Test Site Coordinator (TSC) Responsibilities Overview Attend training provided by district STAR coordinator (Assessment, Research and Evaluation-ARE) Study and become familiar with the documents and procedures: – 2012 STAR District and Test Site Coordinator Manual – Directions for Administration for at least one-grade level CST and CMA – STAR Test Site Coordinator Summary of Responsibilities Handout 24

TSC Responsibilities Overview Continued Schedule all tests and make-ups within the testing window (See sample schedules posted at Website) Inform teachers, students and parents of the testing schedule and where students are to report on the day tests are administered Train personnel at your site – Use Examiners Training Videos with Updates for 2012 Handout posted on Website – Use Test Examiners and Proctors Training Presentation posted on Website – Obtain Security Affidavits from all personnel involved 25

TSC Responsibilities Overview Continued Monitor test administration Handle defective test materials Manage emergency situations – Use Appendix C: STAR Program Irregularities and Incidents, pages of manual – Complete the appropriate report form and send a copy to the district coordinator 26

TSC Responsibilities Overview Continued Maintain the security of all testing materials – When conducting inventory, begin with Box 1 and use the Test Site Packing List to verify that all materials were packaged accurately – Lock Freight Kit packet in secure place with test materials until needed – Contact Assessment, Research and Evaluation ( ) immediately for any discrepancies. – Save original boxes for returning materials Distribute/collect test materials daily at your site – No test materials should be left in a classroom overnight – Use Inventory Forms posted at Website Ensure testing of all students in grades 2-11 Act as liaison between your site and district coordinator Obtain/return all test materials to/from district on time 27

Pre-identified (Pre-ID) Documents Pre-identified students have pre-printed answer documents Newly enrolled students (02/01-04/18/12) – Check for pre-printed label, if available, put it on answer document and treat document the same as if pre-ID. – If no pre-printed label, hand-bubble all demographic fields. 28

CMA Materials 2012 CMA booklets for grade 3 – Separate scorable test booklet – If no CST taken, return CST test booklet with nonscorables CMA for Grades 4–7 – CST and CMA in same answer document – Grade 5 ONLY allows calculator (if written into the IEP) CMA for grade 8 if at least one CMA test is pre-identified for a student, the student will receive both the CMA and the CST pre- identified answer documents If both CST and CMA taken, must mark Section 7c for CMA tests taken 29

CST/CMA Answer Document Right side of inside of answer doc grades 4−7 CMA section has: Different subject icons from CST Alternate row shading for the response bubbles Three options choices Fewer number of questions 30

CMA Grade 7 Answer Document Mathematics Section Grade 7 mathematics and Algebra I have different numbers of questions 31

Coding Student Information Pre-ID Answer Documents Pre-ID Barcode: Check student name and give to correct student 32 On the first day of testing, per teacher-read instructions, all students must complete Section 1

Coding Student Information Blank Answer Documents 33 On the first day of testing, per teacher-read instructions, all students must complete Section 1 All demographic information must be hand-gridded.

Coding Student Information Test Version Numbers (Gr. 8) Students will have 2 answer docs if they are taking CMA Must mark version # for grade level tests and EOC tests Gr. 8 CST, pp. 2 & 3 Gr. 8 CMA, p. 2 34

A2: Special Conditions Test coordinator completes A, E, M, P, & T Teacher completes C, F, L, X, Y, & Z A4: English Learner (EL) Test Variations Examiner completes if any EL variations were used Coding Student Information After Each Test 35 A3: Accommodations and Modifications Examiner marks whether student has IEP or 504 Plan and which accommodations were used

36 Two types of testing variations – ALL – available for all students – 1 – available if regularly used in the classroom Testing Variations

37 Students may use accommodations and/or modifications if – Specified in IEP or Section 504 Plan and – Regularly used in the classroom Accommodations and modifications are to be used only to allow a student to access the test, not to provide an advantage – Accommodations do not change what the test is measuring – Modifications change what the test is measuring Note: Refer to Appendix E: Allowable Test Variations, Accommodations, and Modifications, pp in Coordinator Manual Accommodations & Modifications

Preparing Documents for Return Transcribing and Voiding Documents Transcribe braille and large print (or not processed) Write VOID on any answer document(s), with marks, not to be scored; return with nonscorables 38

Preparing Documents for Return School Grade Identification Sheet (SGID) Complete for each set of answer documents or test booklets Check counts to be accurate Place on answer documents for correct – Grade – School (school code machine- marked ) Pre-printed 39

Preparing Documents for Return Complete Master File Sheet Write in: Number of SGID Number of Scorable Documents Totals 40 Return with each school Check counts to be accurate Required with scorables if materials were ordered: – Write “0” (zero), no blanks – If not tested, note that school did not test

Multiple Choice Scorables Packing Order 41

Label Boxes for Return to District Multiple Choice Tests (CST, CMA, CAPA & STS) Scorable Materials Non-scorable Materials Orange LabelsGreen Labels 42

Site Coordinator Segment – CST Middle School – Refer to Site Coordinator Updates for 2012 Handout View Training Video 43

Additional Resources: Rosters Rosters will be sent from – Pre-ID roster Students’ demographic information that have been pre-coded on answer documents or late labels – STS test roster Students who need to take STS – CMA test roster Students who have been identified to participate using CMA on one or more tests – End-of-course test roster (Grades 7-11) End-of-course tests based on student enrollment. Test site coordinators need to verify – Pre-ID roster Code Conversion 44

Resources & Contact Information All training materials and updates will be posted on the district’s Internet: 45 STAR Support Contact: Assessment, Research, and Evaluation 5735 – 47 th Ave. Serna Center, Box 0780 Phone: Fax:

Questions and Answers 46 ?