Jan/Feb 2007CAPA Examiner Train-the-Trainer1 CAPA Training of CAPA Examiners

Jan/Feb 2007CAPA Examiner Train-the-Trainer2 Objectives Train trainers who will ensure that –Examiners administer CAPA accurately and consistently –Examiners and observers score CAPA accurately and consistently Audience Examiners Observers (second raters) Page 1

Jan/Feb 2007CAPA Examiner Train-the-Trainer3 Agenda Introductions CAPA – Past, Present, and Future Preparing To Administer CAPA Administering CAPA Scoring CAPA Practice Page 1

Jan/Feb 2007CAPA Examiner Train-the-Trainer4 Introduction Video Jack O’Connell State Superintendent of Public Instruction Deb Sigman California Testing Director Mary Hudler California Special Education Director

Jan/Feb 2007CAPA Examiner Train-the-Trainer5 CAPA Past, Present, and Future 1997 –IDEA 1997 – Alternate Assessment for those not able to take regular assessments 2002 –Fall field test 2003 –First operational CAPA test administered –Based on K–2 standards

Jan/Feb 2007CAPA Examiner Train-the-Trainer6 CAPA Past, Present, and Future 2003 (cont.) –CAPA recognized as Alternate Assessment for students with significant cognitive disabilities for NCLB accountability calculations 2004 –No significant changes! 2005 –CAPA testing dates aligned with CST testing dates

Jan/Feb 2007CAPA Examiner Train-the-Trainer7 CAPA Past, Present, and Future 2006 –State Board of Education adopted new blueprints for CAPA aligned to alternate achievement standards –41,965 tested with CAPA –~0.86% of all students tested in STAR –8,923 tested with CAPA level I –~21% tested at CAPA level I

Jan/Feb 2007CAPA Examiner Train-the-Trainer8 CAPA Past, Present, and Future 2007 – Transition year –Operational items based on old K–2 content standards –Field test items based on new blueprints –ELA and Math 8 Operational items –Based on existing K–2 content standards 4 field test items –Based on new blueprints –Science 12 field test items –Based on new blueprints

Jan/Feb 2007CAPA Examiner Train-the-Trainer9 CAPA Past, Present, and Future 2008 – New CAPA –New standards settings Help to ensure continuity of reporting performance –All test items based on new blueprints 12 items per content area 8 Operational 4 Field test

Jan/Feb 2007CAPA Examiner Train-the-Trainer10 Students Eligible To Take CAPA Severe cognitive disabilities Served under IDEA IEP team determines if CAPA is applicable Eligibility guidelines –CAPA Examiner’s Manual – Appendix A Page 2

Jan/Feb 2007CAPA Examiner Train-the-Trainer11 Students who repeat grade eleven for multiple years continue to take CAPA Level I or Level V as their statewide assessment until enrolled in grade 12 Page 1 CAPA Levels

Jan/Feb 2007CAPA Examiner Train-the-Trainer12 Examiners Must meet examiner qualifications Training – Live session or DVD/Video Sign security affidavit Practice with colleagues

Jan/Feb 2007CAPA Examiner Train-the-Trainer13 Observers/Double Raters Must meet examiner qualifications Training – Live session or DVD/Video Sign security affidavit Practice with colleagues Purpose of Observers/Double Raters –Double rate a student’s responses –Data used to document Inter-Rater Reliability –Provides credibility/confidence to scores

Jan/Feb 2007CAPA Examiner Train-the-Trainer14 Double Rating Choose students randomly at each school –10% per CAPA level –Selected students should be double rated in all content areas tested

Jan/Feb 2007CAPA Examiner Train-the-Trainer15 When To Administer CAPA Same test window as STAR CSTs –85% of instruction completed –10 days before or 10 days after Plan for classroom coverage Allow enough time Work testing into daily activities

Jan/Feb 2007CAPA Examiner Train-the-Trainer16 Preparing To Administer CAPA Study CAPA Examiner’s Manual Assemble manipulatives –Determined by version, level, and content area Organize stimulus cards –Some require cutting Determine what, if any, adaptations are required for each student Pages 4–6

Jan/Feb 2007CAPA Examiner Train-the-Trainer17 Video Adaptations

Jan/Feb 2007CAPA Examiner Train-the-Trainer18 Preparing To Administer CAPA Prepare the answer document – Examiner –Mark any demographic information not provided in Pre-ID file –At time of test – complete name, sign, date, and mark “Examiner” Page 13

Jan/Feb 2007CAPA Examiner Train-the-Trainer19 Preparing To Administer CAPA Prepare the answer document – Observer –At time of test – complete name, sign, date, and mark “Observer” Page 13

Jan/Feb 2007CAPA Examiner Train-the-Trainer20 Observers must mark sections 1 - Name, etc. 3 - Date of Birth 5 - Name 6 - Gender 7a - CAPA Level 7b - Grade 11 - Student ID 12 - SSID Page 11 Preparing To Administer CAPA

Jan/Feb 2007CAPA Examiner Train-the-Trainer21 CAPA Test Security Examiner’s Manual includes test items Examiners receive test materials at least one week prior to testing period Store in a locked cabinet when not in use for preparation or test administration Not secure: manipulatives, stimulus cards

Jan/Feb 2007CAPA Examiner Train-the-Trainer22 Break 10 minutes

Jan/Feb 2007CAPA Examiner Train-the-Trainer23 How To Administer CAPA Task preparation Cue/directions Scoring rubric Page 7

Jan/Feb 2007CAPA Examiner Train-the-Trainer24 Video Best Practices Level I

Jan/Feb 2007CAPA Examiner Train-the-Trainer25 Cue/Directions Level I Cue/directions –Wait minimum of 5 seconds for verbal response; Wait minimum of 7 seconds for physical response Repeat cue/directions –Wait minimum of 5 seconds for verbal response; Wait minimum of 7 seconds for physical response Page 8

Jan/Feb 2007CAPA Examiner Train-the-Trainer26 Cue/Directions Level I (continued) Verbal/gestural prompt; repeat cue/directions –Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response Physical prompt or model; repeat cue/directions –Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response Page 8

Jan/Feb 2007CAPA Examiner Train-the-Trainer27 Video Best Practices Levels II – V

Jan/Feb 2007CAPA Examiner Train-the-Trainer28 Cue/Directions Levels II-V Cue/direction –Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response Repeat cue/direction –Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response Page 9

Jan/Feb 2007CAPA Examiner Train-the-Trainer29 Practice Explaining Flowcharts Work with a partner: Round 1: Partner A explains Level I scoring flow chart Round 2: Partner B explains Level II–V scoring flow chart Pages 8–9

Jan/Feb 2007CAPA Examiner Train-the-Trainer30 Rubrics Scoring points Level I : Based on prompting required by student to complete task –Score 1–5 Levels II – V : Based on number of correct responses –Score 1–4 –Red line score of 5 on answer document Page 7

Jan/Feb 2007CAPA Examiner Train-the-Trainer31 Practice Administering CAPA Decide how to score video example Practice with a partner Page 10

Jan/Feb 2007CAPA Examiner Train-the-Trainer32 Video Level I Math

Jan/Feb 2007CAPA Examiner Train-the-Trainer33 Practice Administering CAPA Decide how to score Jesus Page 10

Jan/Feb 2007CAPA Examiner Train-the-Trainer34 Practice Administering CAPA Correct score for Jesus Page 10

Jan/Feb 2007CAPA Examiner Train-the-Trainer35 Video Level V ELA Scoring Rubric Score 4- 4 Correct student responses Score 3- 3 Correct student responses Score 2- 1 or 2 Correct student responses

Jan/Feb 2007CAPA Examiner Train-the-Trainer36 Practice Administering CAPA Decide how to score Stephan H 10

Jan/Feb 2007CAPA Examiner Train-the-Trainer37 Practice Administering CAPA Correct score for Stephan H 10

Jan/Feb 2007CAPA Examiner Train-the-Trainer38 After Test Complete Sections A2 and A4 if appropriate Section A2 – Special Testing Conditions –Reasons student not tested P, A, T, E, M, F –L: Enrolled after first day of testing; test taken at your school Section A4 – English Learner Test Variations –A: Student given directions in language other than English Pages 13–14

Jan/Feb 2007CAPA Examiner Train-the-Trainer39 After Test Return: Secure materials –CAPA Examiner’s Manuals (Non-scorable) –CAPA answer documents (Scorable) Examiner Observer (Do not compare to examiner’s document) Retain or destroy: Non-secure materials –Manipulatives –Stimulus cards

Jan/Feb 2007CAPA Examiner Train-the-Trainer40 Summary Introduction CAPA – Past, Present, and Future Preparing To Administer CAPA Administering CAPA Scoring CAPA After-Test Procedures Complete Evaluation –Thank you Page 15

Jan/Feb 2007CAPA Examiner Train-the-Trainer41 For more information go to: