2010 STAR Order Management Workshop October 28, 2009 Start Time 9:00 a.m. Presenter: Mark Hansen and Michael McDaniel October 2009STAR Order Management1

Objectives District STAR coordinators will identify: Which materials to order How to order test materials October 2009STAR Order Management2

Agenda Major changes and reminders for 2010 Ordering Eligibility for tests  CMA  CAPA  STS What needs to be ordered?  Discussed by grade Eligibility for end-of-course (EOC) CST tests  Mathematics  Science  World History Eligibility for EOC CMA test  Mathematics (Algebra I) Eligibility for EOC STS tests  Mathematics (Algebra I and Geometry) October 2009STAR Order Management3

Agenda Ordering materials  Overview of process  Ordering options –Online ordering –Batch file submission October 2009STAR Order Management4

What’s New The California Standards Test (CST) and California Modified Assessment (CMA) for Writing will be offered to students in grade seven only. The CMA multiple-choice test will be administered to students in grade nine (English–language arts), grade ten (Life Science), and seven through eleven (Algebra I). Students taking the CMA in grades eight through eleven will receive a separate CMA answer document. CST answer documents will always be provided to students in grades eight through eleven. CMA Directions for Administration (DFAs) for all grade levels will be calculated as one DFA per every 10 tests ordered. October 2009STAR Order Management5

What’s New (continued) Audio CDs are no longer available. Braille is available for the CMA in grades six through eight ELA, grades six and seven mathematics, and grade eight science (but not for the CMA for grade nine, grade ten and Algebra I). The “Supplemental Order / Late Label Cutoff Date” will be calculated as seven calendar days before the selected last testing date. The “Transfer Student Cutoff Date,” for Pre-ID will be calculated as seven calendar days before the selected last testing date. While ordering forms like the “Add Initial Order” form and reports pages like the “Approve Order” page display fields for grade four Writing tests, audio CDs, and additional Version 1 test booklets, these materials are not available for order. Numbers entered into these fields will be disregarded. Additional Version 1 test booklets will be available as supplemental orders. October 2009STAR Order Management6

District Preparation Checklist  Obtain school calendars  Including nonpublic, nonsectarian schools (NPS)  Obtain warehouse calendar  Identify dependent charter schools  Identify NPSs providing special education services  Collect order numbers from test site coordinators October 2009STAR Order Management7

Site Preparation Checklist: Give to District STAR Coordinator  School calendar(s)  Number and type of test booklets required  Based on individualized education programs (IEPs) –CMA  Grades 3–9 for ELA and grades 3–7 for mathematics  Grades 5, 8, and 10 (Life Science)  Algebra I, grades 7–11 –CAPA –Special versions  Large print available for all tests  Braille »CSTs—All tests »CMA—Grades 3–8 (but not Algebra I) »STS—All tests October 2009STAR Order Management8

Site Preparation Checklist: Give to District Coordinator (cont.)  Based on mathematics department chair input –CST for Algebra I  Grades 7–11 –Other EOC mathematics (grades 8–11) –STS for Algebra I and STS for Geometry  Grades 7–11 STS Algebra  Grade 8-11 STS Geometry  Based on science department chair input –EOC science  grades 9–11  Based on history–social science department chair input –EOC World History  grades 9–11 October 2009STAR Order Management9

Site Preparation Checklist: Give to District Coordinator (cont.)  Based on English learner status –STS  Grades 2–11  Number of additional DFAs needed for CST, CMA, and STS.  CMA DFAs calculated 1 per 10  CST/STS DFAs calculated 1 per 20 October 2009STAR Order Management10

General Rules for Ordering Do NOT over-order  Districts are sent 5% overage  Schools are sent 10% overage Be realistic with quantities  Especially large print, braille –These materials are expensive!  Mobile populations (county offices) –Average prior year’s order, then use “Supplemental Order” process if necessary October 2009STAR Order Management11

California Modified Assessment Who Takes the CMA? Available in grades 3–9 for ELA, grades 3–7 for mathematics, grades 7–11 for EOC Algebra I, and grades 5, 8, and 10 for science. Eligible students shall, in part: 1.Have an IEP that specifies that they take the CMA for one or more subjects; and 2.Scored below basic or far below basic in a previous year on the CST in the subject area being assessed by the CMA and may have taken the CST with modifications; or 3.Have taken the CAPA Level II–V in two previous years and received a performance level of either proficient or advanced. Student may test one or more content areas with CMA, e.g. CMA for Mathematics, CST for ELA October 2009STAR Order Management12

California Alternate Performance Assessment Who Takes the CAPA? Student must have an IEP Student’s IEP must specify CAPA and determine if student should take grade assigned CAPA level, or CAPA Level I. Note: Student counts by CAPA level are not necessary during the ordering process. October 2009STAR Order Management13

What needs to be ordered? CAPA Examiner’s Manual: One for each examiner  Can be used for several students  All CAPA levels covered  One version per school district Answer documents  One per student taking the CAPA  All CAPA levels covered  10% double-rated (use overage) –Will be discussed in Pre-Test Workshop October 2009STAR Order Management14

CAPA Manipulatives Not ordered through ETS School districts need to assemble manipulatives Dependent upon  CAPA version –Assigned by ETS (available in early December)  CAPA level –Determined by IEP team  Designate the use of Level I or grade- appropriate level Manipulatives list indicates  Single-use items  Multi-use items October 2009STAR Order Management15

Standards-based Tests in Spanish Who takes the STS? Available at grades 2–11  Spanish-speaking English learners (EL) –Required to take STS if they:  Are receiving instruction in Spanish OR  Will have attended U.S. schools less than 12 cumulative months on the first day of testing (regardless of whether they receive instruction in English or Spanish) –At the option of the school district:  Any other Spanish-speaking English learners Not to be administered to Non-ELs –E.g. English-only, I-FEP, R-FEP students –English learners whose primary language is not Spanish October 2009STAR Order Management16

What Needs to Be Ordered, by Grade October 2009STAR Order Management17

What needs to be ordered? Grade 2 CST grade-level test booklet for each student to be tested  Contains: –CST for English–Language Arts –CST for Mathematics STS grade-level test booklet for each student eligible to be tested with the STS  Contains: –STS for Reading/Language Arts –STS for Mathematics October 2009STAR Order Management18

What needs to be ordered? Grade 3 CST grade-level test booklet for each student to be tested with one or more CST  CST test booklet contains: –CST for English–Language Arts –CST for Mathematics CMA test booklet for each student eligible to be tested with one or more CMA  Contains: –CMA for English–Language Arts –CMA for Mathematics STS grade-level test booklet for each student eligible to be tested with the STS  Contains: –STS for Reading/Language Arts –STS for Mathematics October 2009STAR Order Management19

What needs to be ordered? Grade 4 CST grade-level test booklet for each student to be tested with one or more CST  Contains: –CST for English–Language Arts –CST for Mathematics CMA grade-level test booklet for each student eligible to be tested with one or more CMA  Contains: –CMA for English–Language Arts –CMA for Mathematics STS grade-level test booklet for each student eligible to be tested with the STS  Contains: –STS for Reading/Language Arts –STS for Mathematics October 2009STAR Order Management20

What needs to be ordered? Grade 5 CST grade-level test booklet for each student to be tested with one or more CST  Contains: –CST for English–Language Arts –CST for Mathematics –CST for Science CMA grade-level test booklet for each student eligible to be tested with one or more CMA  Contains: –CMA for English-Language Arts –CMA for Mathematics –CMA for Science STS grade-level test booklet for each student eligible to be tested with the STS  Contains: –STS for Reading/Language Arts –STS for Mathematics October 2009STAR Order Management21

What needs to be ordered? Grade 6 CST grade-level test booklet for each student to be tested with one or more CST  Contains: –CST for English–Language Arts –CST for Mathematics CMA grade-level test booklet for each student eligible to be tested with one or more CMA  Contains: –CMA for English-Language Arts –CMA for Mathematics STS grade-level test booklet for each student eligible to be tested with the STS  Contains: –STS for Reading/Language Arts –STS for Mathematics October 2009STAR Order Management22

What needs to be ordered? Grade 7 CST grade-level test booklet for each student to be tested  Contains: –CST for English–Language Arts –CST for Mathematics –For students not completing an Algebra I course CMA grade-level test booklet for each student eligible to be tested with one or more CMA  Contains: –CMA for English–Language Arts –CMA for Mathematics –For students not completing an Algebra I course CST or CMA Algebra I test booklet  For students completing a standards-aligned Algebra I course October 2009STAR Order Management23

What needs to be ordered? Grade 7 (cont.) STS grade-level test booklet for each eligible student  Contains: –STS for Reading/Language Arts –STS for Mathematics (grade-level) –No STS for Writing test EOC mathematics STS test booklet  For students completing a standards-aligned Algebra I course CST Writing test booklet for all students taking the CST for ELA CMA Writing test booklet for all students taking the CMA for ELA October 2009STAR Order Management24

What needs to be ordered? Grade 8 CST grade-level test booklet for each student to be tested  Contains: –CST for English–Language Arts –CST for Science –CST for History–Social Science EOC mathematics CST test booklets  All grade 8 students MUST take a mathematics test –CST or CMA for Algebra I –CST for General Mathematics, CST for Geometry, and so forth  Courses aligned with the CST blueprint October 2009STAR Order Management25

What needs to be ordered? Grade 8 (cont.) CMA grade-level test booklet for each student eligible to be tested with one or more CMA  Contains: –CMA for English-Language Arts –CMA for Science  Appropriate EOC CST for Mathematics or CMA for Algebra I October 2009STAR Order Management26

What needs to be ordered? Grade 8 (cont.) STS grade-level test booklet for each student eligible to be tested with the STS  Contains: –STS for Reading/Language Arts EOC mathematics STS test booklet  For students completing a standards-aligned Algebra I or Geometry course October 2009STAR Order Management27

What needs to be ordered? Grade 9 CST grade-level test booklet for each student to be tested  Contains: –CST for English–Language Arts CMA grade-level test booklet for each student eligible to be tested with one or more CMA  Contains: –CMA for English–Language Arts EOC mathematics test booklet  All grade 9 students MUST take a mathematics test –CST or CMA for Algebra I –CST for General Mathematics, CST for Geometry, etc.  Courses aligned with the CST blueprint October 2009STAR Order Management28

What needs to be ordered? Grade 9 (cont.) EOC science test booklet  Biology, Earth Science, Physics, etc.  Courses aligned with the CST blueprint EOC world history test booklet  Course aligned with the CST blueprint STS grade-level test booklet for each student eligible to be tested with the STS  Contains: –STS for Reading/Language Arts EOC mathematics STS test booklet for each student eligible to take an end-of-course test  Contains: –STS for Algebra I or STS for Geometry October 2009STAR Order Management29

What needs to be ordered? Grade 10 CST grade-level test booklet for each student to be tested  Contains: –CST for English–Language Arts –CST for Life Science CMA grade-level test booklet for each student to be tested  Contains: –CMA for Life Science EOC mathematics test booklet –CST or CMA for Algebra I –CST for Algebra II, CST for Geometry, etc.  Courses aligned with the CST blueprint October 2009STAR Order Management30

What needs to be ordered? Grade 10 (cont.) EOC science test booklet  Contains: –Earth Science, Biology, Physics, etc. –Courses aligned with the CST blueprint EOC world history test booklet  Course aligned with the CST blueprint STS grade-level test booklet for each student eligible to be tested with STS  Contains: –STS for Reading/Language Arts EOC mathematics STS test booklet for each student eligible to take an end-of-course test  Contains: –STS for Algebra I or STS for Geometry October 2009STAR Order Management31

What needs to be ordered? Grade 11 CST grade-level test booklet for each student to be tested  Contains: –CST for English–Language Arts –CST for U.S. History EOC mathematics test booklet –CST or CMA for Algebra I –CST for Algebra II, CST for Geometry, etc.  Courses aligned with the CST blueprint End-of-course science test booklet  Earth Science, Biology, Physics, etc.  Courses aligned with the CST blueprint October 2009STAR Order Management32

What needs to be ordered? Grade 11 (cont.) End-of-course world history test booklet  Course aligned with the CST blueprint STS grade-level test booklet for each student eligible to be tested with the STS  Contains: –STS for Reading/Language Arts EOC STS test booklet for each student eligible to take an end-of-course test  Contains: –STS for Algebra I or STS for Geometry EAP Essay test booklet October 2009STAR Order Management33

Who Takes CST or CMA for EOC Mathematics? Grades 2–9  ALL students take a mathematics test Grades 10 and 11  Students may take no mathematics test if they are not enrolled in a mathematics course and did not previously complete Algebra II or a course aligned with the Integrated Mathematics 3 test blueprint or they are enrolled in the first year of a two-year mathematics course or enrolled in General Mathematics or Business Mathematics Determine which mathematics test will be administered in grades 7–11  Review state blueprints  Review curriculum  Review rules  CMA students should take the CMA for Algebra I, an EOC mathematics CST, or the CST for General Mathematics (grades 8 and 9 only) October 2009STAR Order Management34

Who takes the STS for EOC Mathematics? The STS for Algebra I is available for students in grades 7–11 The STS for Geometry is available for students in grades 8–11  Must be –Spanish-speaking English learners (EL) –Not to be administered to non-ELs such as English-only, I-FEP, R-FEP Same EOC rules as CST/CMA  Completing the course or completed it in the summer of 2009 October 2009STAR Order Management35

Which Students Take the CST for General Mathematics? Students in grades 8 or 9 only who are:  Not taking a mathematics course Or  Taking any mathematics course prior to Algebra I (e.g. Pre-Algebra, Algebra Readiness, Business mathematics, etc.) Or  Not in the last year of a multi-year Algebra I course October 2009STAR Order Management36

Which Students Take Algebra I? Students in grades 7–11 who are completing Algebra I or completed it in the summer of 2009 Grade 7 students not completing Algebra I take the grade 7 mathematics test October 2009STAR Order Management37

Which Students Take Summative High School Mathematics? Students in grades 9–11 who have completed Algebra II or a course aligned with the Integrated Mathematics 3 test blueprint in a previous school year, and who:  Are taking higher-level mathematics courses; or  Are taking no mathematics courses; or  May have taken the CST for Summative High School Mathematics previously October 2009STAR Order Management38

Example 1 Jenny  2009 –Grade 9 student –Took Algebra II –Took the CST for Algebra II  2010 –Grade 10 student –Not studying mathematics –Takes CST for Summative High School Mathematics October 2009STAR Order Management39

Example 2 James  2009 –Grade 9 student –Took Geometry –Took the CST for Geometry  2010 –Grade 10 student –Not studying mathematics –Takes no mathematics test October 2009STAR Order Management40

Example 3 Juan  2009 –Grade 10 student –Studying an advanced mathematics class –Took the CST for Summative High School Mathematics  2010 –Grade 11 student –Not studying mathematics –Takes the CST Summative High School Mathematics October 2009STAR Order Management41

Example 4 Juliet  2009 –Grade 10 student –Studying an advanced mathematics course –Took the CST for Summative High School Mathematics  2010 –Grade 11 student –Studying Calculus –Takes the CST for Summative High School Mathematics October 2009STAR Order Management42

Which students take End-of-Course Science? Students in grades 9–11  Completing or completed in summer of 2009, California standards-aligned science course –Review state blueprints –Review curriculum All students in grade 10 take the Life Science test  Test printed in the grade 10 test booklet (both CST and CMA)  Most grade 10 students will take TWO science tests October 2009STAR Order Management43

Which students take End-of-Course World history? Students in grades 9–11  Completed the World History course in the 2009 summer session or will complete it during the school year All students in grade 11 will take the CST for U.S. History  The test is printed in the grade 11 test booklet  Some grade 11 students will take TWO History– Social Science tests October 2009STAR Order Management44

EAP Essay Grade 11  Order for all students  Must be taken in conjunction with additional ELA multiple-choice questions to achieve an exemption from CSU placement tests upon admission to a campus and participating California Community Colleges  Order entered on the Early Assessment Program administration (EP01)  Approve order separately October 2009STAR Order Management45

15-minute break for everyone! October 2009STAR Order Management46

Test Administrations Multiple-choice  Up to 8 administrations allowed MC01 – MC08  Each administration should have different date for “First day of testing”  Each administration’s order needs to be approved separately –Enter orders for ALL administrations before starting approval process –Report for 2010 provides list of schools without orders –Report generated when each order approved Writing Application (grade 7 only)  Administration WA01 –March 2 with make-up on March 3 if in session on March 2  Administration WA02 –May 4 with make-up on May 5 ONLY if not in session on March 2  Enter and approve order separately from multiple-choice Early Assessment Program (EAP) Essay  Administration EP01 –March 2 through March 31  Enter and approve order separately from multiple choice October 2009STAR Order Management47

Ordering Procedures 1.Set up test administration dates See Webcast “2010 STAR Test Administration Setup” Manual posted at 2.Confirm “Profile” information Primary Shipping Address Secondary Shipping Address (optional) –Can be used for Supplemental Order delivery Report Shipping Address (optional) –Used to deliver Reports in summer 2010 –Address must be set up before June 1, 2010 October 2009STAR Order Management48

Ordering Procedures 1.Enter order quantities for each Multiple-Choice, Writing Application, and the Early Assessment Program administration. Screen entry or Produce file containing order quantities and upload 2.Approve order for each administration. October 2009STAR Order Management49

Software Demonstration 1.Verify Profile 2.Enter order online 3.Approve order October 2009STAR Order Management50

October 2009STAR Order Management51

October 2009STAR Order Management52

October 2009STAR Order Management53

October 2009STAR Order Management54

October 2009STAR Order Management55

October 2009STAR Order Management56

October 2009STAR Order Management57

October 2009STAR Order Management58

October 2009STAR Order Management59

October 2009STAR Order Management60

October 2009STAR Order Management61

October 2009STAR Order Management62 School district cannot approve order when errors still exist

October 2009STAR Order Management63

October 2009STAR Order Management64

October 2009STAR Order Management65 Book count warnings Schools with no orders School district can still approve order when warnings exist

October 2009STAR Order Management66

October 2009STAR Order Management67

October 2009STAR Order Management68

October 2009STAR Order Management69

October 2009STAR Order Management70

STAR Order Management File upload option October 2009STAR Order Management71

Changes to Batch Procedure Do not need to zero-fill quantities  Numbers must be right-justified  E.g., 0012 may also be entered as _ _12 No special sequence of records required October 2009STAR Order Management72

Order File Upload Format October 2009STAR Order Management73 Included in Order Management Manual Fixed-length field; text file only Orders for one administration only per file

Sample File October 2009STAR Order Management74

Sample October 2009STAR Order Management

Review and Approve Review orders using  Online screens And/or  Printouts generated by STAR Management System Adjust orders where necessary using  Online entry to adjust quantities Approve orders  All orders entered through “File load” need to be “Approved” by district STAR coordinator October 2009STAR Order Management76

In Conclusion October 2009STAR Order Management77

Excessive Materials Ordered Charges 90% of the value of materials ordered minus value of materials used Be careful ordering!  Do not over-order  Large print and braille –These materials are very expensive No excessive order charges for  EAP Essay test books ETS will invoice approximately December 2010 October 2009STAR Order Management78

Excessive Materials Ordered Charges Value of materials ordered ($x)  Does not include overages  Order quantities will be adjusted based on number of Pre-ID records Value of materials used ($y) If (x-y) ≤ 10%(x) then no charges will apply If (x-y) > 10%(x) then charges will apply October 2009STAR Order Management79

Excessive Materials Ordered Charges Example 1 Value of materials ordered = $5,000 Value of materials used = $4,600 Difference between ordered and used = $400 10% of materials ordered = $500 Difference ($400) is less than 10% of materials ordered ($500)  No charges will apply October 2009STAR Order Management80

Excessive Materials Ordered Charges Example 2 Value of materials ordered = $5,000 Value of materials used = $4,100 Difference between ordered and used = $900 10% of materials ordered = $500 Difference ($900) is greater than 10% of materials ordered ($500)  Charge will apply  Charge will be $900 – $500 = $400 October 2009STAR Order Management81

Review Set up test administration dates  NPS schedules may be different from district schedules Enter order quantities for each administration  Multiple-choice  Writing (CST and CMA, grade 7)  EAP Essay Approve orders  Every administration October 2009STAR Order Management82

Timetable Gather data from sites immediately Enter orders Now through December 1, 2009 Orders reviewed by ETS throughout December and January Adjustments to Initial Orders up until “Order Sent for Packaging” date If required, place “Supplemental Orders” after “Order Sent for Packaging” date Track Order status October 2009STAR Order Management83

Next Webcast 2010 STAR Pre-ID Workshop Webcast November 18, 2009 October 2009STAR Order Management84