1. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 1 January 2009 CAPA Training CAPA Examiners

2. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 2 January 2009 Objectives Participants will train examiners to accurately and consistently  Administer the CAPA  Score the CAPA Handout (HO) Page 1

3. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 3 January 2009 Agenda Introductions Training California Content Standards Preparing Administering the CAPA Scoring the CAPA After-Test Procedures Q & A with the CDE HO 1

4. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 4 January 2009 Training CAPA Examiners Required ANNUALLY Train before testing window opens Tips :  Active learning Practice Discussion Problem-solve  Repetition What other training tips do you have? HO 1

5. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 5 January 2009 California Content Standards Basis of instruction and testing 2006 State Board of Education adopted new blueprints for CAPA Levels II–V linked to grade level, grades 2–11, of California content standards (federal requirement) Level I is based on CAPA Level I blueprints: linked to grades K–1 of California content standards; science includes grade 2 content standards. See CAPA blueprints: http://www.cde.ca.gov/ta/tg/sr/capablueprints.asp Review sample to see how Alternate Achievement Standard aligns to state standard and how task tests the Alternate Achievement Standard. HO 2

6. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 6 January 2009 Preparing Are Correct Students Selected for CAPA? Significant cognitive disabilities Served under IDEA IEP team determines if CAPA is applicable and if the student should take Level I Eligibility guidelines  CAPA Examiner’s Manual — Appendix A  Assign correct CAPA level HO 3

7. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 7 January 2009 Only students in grades 5, 8, and 10 take science. Students who repeat grade 11 for multiple years continue to take the CAPA Level I or Level V until enrolled in grade 12. Preparing: CAPA Levels HO 3

8. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 8 January 2009 Preparing: Do You (Examiners and Observers) Have Correct Qualifications? Licensed or certificated Experienced working with tested student Trained—Live session or DVD Signed security affidavit HO 3 Why must the answer document be signed?

9. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 9 January 2009 Scoring: Purpose of Observers Increase objectivity Data used to document inter-rater reliability Provide credibility/confidence to scores HO 3

10. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 10 January 2009 Double Rating Choose students randomly at each school  10% per CAPA level per school  At least one student at each level tested  Selected students should be double rated in all content areas tested Observe at same time as examiner scores Observers must score independently of examiner HO 3 How many observers are needed in a school?

11. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 11 January 2009 Preparing Materials Gather manipulatives Cut stimulus cards and have them available in correct order Have an answer document for every student If no Pre-ID, demographics should be hand-marked HO 3

12. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 12 January 2009 Administering the CAPA Task preparation  Set up manipulatives and/or stimulus cards  Must be in exact order specified Cue/directions  Must be read exactly as printed HO 4

13. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 13 January 2009 Changes to Administering CAPA Level I Up to 5 cues given Up to 3 prompts given If no response after verbal/gestural prompt, then modeled prompt only If no response after modeled prompt, then hand-over-hand Student must answer independently after hand-over-hand or any prompt

14. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 14 January 2009 Cue/Directions Level I 1.Give cue/directions  Wait minimum of 5 seconds for verbal response; Wait minimum of 7 seconds for physical response  If student responds (correct or not), STOP. 2.Repeat cue/directions ONCE  Wait minimum of 5 seconds for verbal response; Wait minimum of 7 seconds for physical response  If student responds (correct or not), STOP. HO 4

15. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 15 January 2009 Cue/Directions Level I Prompts 3. Verbal/gestural prompt; repeat cue/directions  Wait  If student responds (correct or not), STOP. 4. Modeled prompt; reset objects; repeat cue/directions  Wait  If student responds (correct or not) or does not respond, STOP. 5. Hand-over-hand prompt; reset objects; repeat cue/directions  Wait  If student responds (correct or not) or does not respond, STOP. HO 4

16. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 16 January 2009 Practice One partner explains to another how to administer Level I. Use the new chart, HO 5. HO 4

17. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 17 January 2009 Cue/Directions Levels II–V Cue/direction  Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response  If student responds (correct or not), STOP. Repeat cue/direction  Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response  STOP Go to next task in question HO 6 Practice: One partner explains to the other how to administer Levels II–V. Use the flow chart.

18. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 18 January 2009 Scoring: Rubrics Scoring points Level I : Based on prompting required by student to complete task  Score 1–5 Levels II–V: Based on number of correct responses  Score 1–4  Red-line score of 5 on answer document HO 7

19. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 19 January 2009 Scoring CAPA Level I If wrong answer given, score 1 Correct answer with first or second cue, score 5 Correct answer with verbal/gestural prompt, score 4 Correct with modeled prompt, score 3 Correct with hand-over-hand prompt, score 2 Orients to task, score 1 No response at any time, score NR HO 7

20. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 20 January 2009 Practice Scoring CAPA Level I See trainer model with Lucerio video Using the video clip, Jasper, ELA, (apple and shoe)  Plan a practice session on scoring  Give directions for the practice to a partner  Give feedback on how the partner scored Jasper HO 7–9

21. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 21 January 2009 Practice CAPA Levels III and V See trainer model with math, Level III, Steven video Using the video clip, science, Level V, Luis  Plan a practice session on scoring  Give directions for the practice to a partner  Give feedback to how the partner scored Luis HO 10–12

22. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 22 January 2009 After Test Procedures: Answer Document Section A2 Special Conditions HO 13 AStudent was absent for regular and make-up testing. EStudent was not tested due to a significant medical emergency FStudent became ill while taking the test; had to leave the room, and was unable to return and complete the test. LStudent enrolled after first day of testing and was given this test. MStudent was enrolled on first day of testing and took one or more tests then moved before this test was administered. PStudent not tested by parent/guardian request. TStudent enrolled on the first day of testing and was not given this test because a staff member verified that the student had taken the test at a previous school

23. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 23 January 2009 After-test Procedures Section A4—English Learner Test Variations  A: Student given directions in language other than English Complete name, sign, date, and mark “Examiner” or “Observer” to attest training received HO 13

24. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 24 January 2009 Observers must mark sections 1 - Name, etc. 3 - Date of Birth 5 - Name 6 - Gender 7a - CAPA Level 7b - Grade 11 - Student ID 12 - SSID Preparing To Administer the CAPA HO 14

25. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 25 January 2009 Questions and Answers California Department of Education

26. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 26 January 2009 Summary Introduction Training Standards Preparation Administration Scoring After-Test Procedures Complete Evaluation CAPA Level I changed

27. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 27 January 2009 Quiz Answers 1.a 2.b 3.b 4.a 5.c 6. c 7. d 8. d 9. b 10. a

28. 2009 STAR CAPA Train-the-Trainer Workshop || Slide 28 January 2009 For more information go to: http://www.cde.ca.gov/ta/tg/sr/capa.asp http://www.startest.org/capa.html