1. Jan/Feb 2008CAPA Train-the-Trainer Workshop1 CAPA Training CAPA Examiners

2. Jan/Feb 2008CAPA Train-the-Trainer Workshop2 Objectives Participants will train examiners to accurately and consistently – Administer CAPA – Score CAPA Handout (HO) Page 1

3. Jan/Feb 2008CAPA Train-the-Trainer Workshop3 Agenda Introductions Training California Content Standards Preparing Administering CAPA Scoring CAPA Problem-Solving After-Test Procedures HO 1

4. Jan/Feb 2008CAPA Train-the-Trainer Workshop4 Training CAPA Examiners Required ANNUALLY Tips: –Active learning Practice Discussion Problem-solve –Repetition HO 1

5. Jan/Feb 2008CAPA Train-the-Trainer Workshop5 California Content Standards Basis of instruction and testing 2006 State Board of Education adopted new blueprints for CAPA Levels II–V linked to grade level, grades 2–11, of California content standards (federal requirement) Level I linked to grades K–1 of California content standards; science includes Grade 2 content standards. Practice: Explain standards to a partner, using sample of old and new tested standards HO 2

6. Jan/Feb 2008CAPA Train-the-Trainer Workshop6 Preparing Are Correct Students Selected for CAPA? Significant cognitive disabilities Served under IDEA IEP team determines if CAPA is applicable and if the student should take Level I Eligibility guidelines –CAPA Examiner’s Manual – Appendix A HO 3

7. Jan/Feb 2008CAPA Train-the-Trainer Workshop7 Only students in grades 5, 8, 10 take science. Students who repeat grade eleven for multiple years continue to take CAPA Level I or Level V until enrolled in grade 12. HO 3 Preparing: CAPA Levels

8. Jan/Feb 2008CAPA Train-the-Trainer Workshop8 Preparing: Do You (Examiners and Observers) Have Correct Qualifications? Licensed or certificated Experienced working with tested student Trained – Live session or DVD Signed security affidavit HO 3

9. Jan/Feb 2008CAPA Train-the-Trainer Workshop9 Preparing Materials Gather manipulatives Cut stimulus cards and have them available in correct order Have an answer document for every student If no Pre-ID, demographics should be hand-marked HO 3

10. Jan/Feb 2008CAPA Train-the-Trainer Workshop10 Administering CAPA Task preparation –Set up manipulatives and/or stimulus cards –Must be in exact order specified Cue/directions –Must be read exactly as printed HO 4

11. Jan/Feb 2008CAPA Train-the-Trainer Workshop11 Cue/Directions Level I Cue/directions –Wait minimum of 5 seconds for verbal response; Wait minimum of 7 seconds for physical response –If student responds (correct or not), STOP. Repeat cue/directions ONCE –Wait minimum of 5 seconds for verbal response; Wait minimum of 7 seconds for physical response –If student responds (correct or not), STOP. HO 4

12. Jan/Feb 2008CAPA Train-the-Trainer Workshop12 Cue/Directions Level I Prompts Verbal/gestural prompt; repeat cue/directions –Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response –If student responds (correct or not), STOP. Physical prompt; repeat cue/directions –Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response –If student responds (correct or not) or does not respond, STOP. –Score 3 if student successfully completes task INDEPENDENTLY after prompt. –Score 2 if student completes task incorrectly or with hand-over-hand guidance. HO 4

13. Jan/Feb 2008CAPA Train-the-Trainer Workshop13 Physical Prompts Modeling completion of the task Physically guiding the student to the task Providing hand-over-hand guidance to complete the task HO 4

14. Jan/Feb 2008CAPA Train-the-Trainer Workshop14 Practice One partner explains to another how to administer Level I. HO 4

15. Jan/Feb 2008CAPA Train-the-Trainer Workshop15 Cue/Directions Levels II–V Cue/direction –Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response –If student responds (correct or not), STOP. Repeat cue/direction –Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response – STOP Practice: Second partner explains to another how to administer Levels II-V. HO 6

16. Jan/Feb 2008CAPA Train-the-Trainer Workshop16 Scoring: Rubrics Scoring points Level I : Based on prompting required by student to complete task –Score 1–5 Levels II–V: Based on number of correct responses –Score 1–4 –Red-line score of 5 on answer document HO 7

17. Jan/Feb 2008CAPA Train-the-Trainer Workshop17 Scoring: Purpose of Double-Raters Increase objectivity Data used to document inter-rater reliability Provide credibility/confidence to scores HO 7

18. Jan/Feb 2008CAPA Train-the-Trainer Workshop18 Double Rating Choose students randomly at each school –10% per CAPA level –At least 1 student at each level tested –Selected students should be double rated in all content areas tested Observe at same time as examiner scores Observers must score independently of examiner HO 7

19. Jan/Feb 2008CAPA Train-the-Trainer Workshop19 Observers must mark sections 1 - Name, etc. 3 - Date of Birth 5 - Name 6 - Gender 7a - CAPA Level 7b - Grade 11 - Student ID 12 - SSID HO 8 Preparing To Administer CAPA

20. Jan/Feb 2008CAPA Train-the-Trainer Workshop20 Practice Scoring CAPA Level I Using the video clip, Nakeema, ELA, (apple and shoe) –Plan a practice session on scoring –Give directions for the practice to a partner –Give feedback to how the partner scored Nakeema HO 9–11

21. Jan/Feb 2008CAPA Train-the-Trainer Workshop21 Practice CAPA Level V Using the video clip, Danny, science –Plan a practice session on scoring –Give directions for the practice to a partner –Give feedback to how the partner scored Danny HO 11–13

22. Jan/Feb 2008CAPA Train-the-Trainer Workshop22 Problem-Solving Discuss with a partner how you would handle problems Add any other problems you think examiners may ask ??????????????????????????????? HO 14

23. Jan/Feb 2008CAPA Train-the-Trainer Workshop23 After-test Procedures Complete Sections A2 and A4 if appropriate Section A2 – Special Conditions –Reasons student not tested P, A, T, E, M, F –L: Enrolled after first day of testing; test taken at your school Section A4 – English Learner Test Variations –A: Student given directions in language other than English Complete name, sign, date, and mark “Examiner” or “Observer” to attest training received HO 15-16

24. Jan/Feb 2008CAPA Train-the-Trainer Workshop24 Summary Introduction Training Standards Preparation Administration Scoring Problem-solving After-Test Procedures Complete Evaluation

25. Jan/Feb 2008CAPA Train-the-Trainer Workshop25 For more information go to: http://www.cde.ca.gov/ta/tg/sr/capa.asp http://www.startest.org/capa.html