1. CAPA 2014 CAPA Examiner & 2 ND Rater Training WELCOME  Please sign-in.  Pick-up training materials  Make yourself comfortable  Please review the 2014 CAPA Examiner Quiz

2. CAPA 2014 CAPA Examiner & 2 ND Rater Training Trainer: Julia Arreguin March 17, 19 or 21, 2014 3:30 to 5:30 WELCOME March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 2

3. Agenda Introductions / training packet contents Objectives Training requirement New in 2014 California Content Standards Who & why Preparing Double Rating (‘Observer’) Administering the CAPA Scoring the CAPA Practice After-Test Procedures Questions March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 3

4. Objectives Participants will learn to accurately and consistently  Prepare for CAPA  Administer the CAPA  Score the CAPA  Return CAPA March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 4

5. What’s New in 2014? goodbye STAR  hello CAASPP California Assessment of Student Performance and Progress If student is in ungraded program, determine grade by subtracting 5 from student’s age as of October 1, 2013 (used to be Nov. 1) VERSION - o nly one version this year SJUSD CAPA Examiner / 2 nd Rater WorkshopMarch 2014

6. Training CAPA Examiners Is Required ANNUALLY (before the testing window opens) Training options: –Facilitated district training –Individual or Collaborative DVD training –View archived web video-streamed training Training best practice: –Active learning Practice Discussion Problem-solving –Repetition March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 6 Quiz Question #1

7. California Content Standards & CAPA Blueprint Standards provide the basis of instruction and testing* In 2006 the CA State Board of Education adopted new blueprints for CAPA CAPA Level I blueprints: link to grades K–1 of California content standards and include two additional grade 2 science content standards. Levels II–V blueprints: link to grade level (grades 2–11) California content standards - CAPA blueprints can be found on the CDE Website at http://www.cde.ca.gov/ta/tg/sr/capablueprints.asp - Copies of our SJUSD publication are available upon request. CAPA continues to be aligned with the ‘old standards’ …. March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 7 The Common Core Standards are coming!!!

8. California Content Standards & CAPA Blueprint Sample of Grade Five English-Language Arts Strand: Reading/Word Analysis Standard: 6RW1.1: Word Recognition: Read aloud narrative and expository text fluently and accurately, and with appropriate pacing, intonation, and expression. Alternate Achievement Standard: Read a simple four- to five- word sentence composed of high-frequency words. March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop The Common Core Standards are coming!!!

9. The Common Core Standards are coming in 2014 Learn more about California’s implementation of the Common Core State Standards (CCSS) for the Special Education Community at: http://www.cde.ca.gov/sp/se/cc/ California is a tier 2 member of ‘NCSC’ (National Center and State Collaborative), a multi-state consortia. Learn more about NCSC at: http://www.ncscpartners.org/ March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 9 The Common Core Standards are coming!!!

10. Preparing Are Correct Students Selected for CAPA? Significant cognitive disabilities Served under IDEA (must have an IEP) Curriculum & goals based upon the alternate standards IEP team - determines if CAPA is applicable, and if the student should take Level I Eligibility guidelines  See CAPA Examiner’s Manual (Appendix A)  Assigned correct CAPA level March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 10

11. All students take ELA and mathematics. Only students in grades 5, 8, and 10 take science. Students who repeat grade 11 for multiple years continue to take the CAPA Level I or Level V until: – Enrolled in grade 12 (or) – Turn 22 years of age and are no longer receiving compensatory education. March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 11 Preparing: CAPA Levels Preparing: CAPA Levels See CAPA Examiner’s Manual Appendix B

12. Preparing: Students in Ungraded Classrooms To determine a student’s grade (for ungraded programs), subtract 5 from student’s age as of October 1, 2013. Formula: (age – 5 = grade) Example: Chris is 12 years old. Subtract 5 from 12 to calculate the grade for CAPA testing. Chris would take Level IV. Formula: 12 – 5 = 7 March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop

13. Preparing Do You (Examiners and Observers) Have Correct Qualifications? Licensed or certificated Experience working with ‘CAPA’ students Trained annually - see CAPA manual (p. 12) & sample answer document –Trained either by attending a “live” session or watching the online video segments (same as previous training DVD http://www.startest.org/capa.html Signed STAR security affidavit (handout) March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 13

14. Preparing Materials *See examiner’s manual* Gather manipulatives - SJUSD has been assigned version #2 (*Appendix E, p. 115-118) CAPA materials (examiner manuals / stimulus cards / answer documents) should arrive @ one week before testing window (FYI – should be delivered to schools in early April) - SJUSD Testing window is April 22 thru May 10, 2014. Read the Examiner’s Manual carefully. Cut stimulus cards and have them available in the correct order as directed in the Examiner’s Manual Plan any core adaptations (* p. 23-24) for students with additional disabilities; must be the same adaptations used during class instruction; PDF versions of the 2014 stimulus cards are now available for students who need the images projected via computer & interactive whiteboard (be cognizant of security if doing this….) Email jarreguin@sanjuan.edu Prepare an answer document for every student – fill in missing info (version #; CAPA level, disability, etc.); if not Pre-ID, all demographics should be hand-marked See *Appendix D – for directions & codes March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 14

15. 1 - Name, etc. 3 - Date of Birth 5 - Name 6 - Gender 7a - CAPA Level 7b - Grade 11 - Student ID 12 - SSID March 2014 Preparing To Administer the CAPA SJUSD CAPA Examiner / 2 nd Rater Workshop Fill out a second document (sections above) for those being ‘observed’/2 nd rated

16. Preparing All Answer Docs: Must Mark Whether Pre-ID or Not 1 Hand-write –Student Name –Test Examiner –School –District 7a CAPA Level March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 16

17. Preparing Answer Documents: CAPA Level March 2014 Mark correct CAPA level The CAPA level must match the valid grade level Not counted if ‘out of level’ (this impacts your school’s API….) SJUSD CAPA Examiner / 2 nd Rater Workshop

18. Scoring: Purpose of Observers (aka 2 nd Raters, Double-Raters) Increase objectivity Data used to document inter- rater reliability Provide credibility/confidence to scores March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 18

19. Observer Double Rating SJUSD will choose students randomly for each school (List will be distributed by the AEP Dept.) –10% per CAPA level (per school) –At least 1 student at each level tested (per school) –Selected students should be double rated in all content areas tested Observe & score (2 nd rate) at the same time as examiner administers and scores Observers must score independently of examiner (do not compare documents!) March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 19 Quiz Question #2

20. Use blank from overage. Observers must mark sections 1 – Name, etc. 3 – Date of Birth 5 – Name 6 – Gender 7a – CAPA Level 7b – Grade 11 – Student ID 12a – SSID Preparing To Administer the CAPA Observers’ Answer Doc March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 20

21. Administering CAPA Task preparation –Set up manipulatives and/or stimulus cards –Must be in exact order specified Cue/directions –Must be read exactly as printed March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 21

22. Scoring: Rubrics Scoring points Level I : Based on prompting required by student to complete task –Score 1–5 or NR Levels II–V: Based on number of correct responses –Score 1–4 or NR (do not use the shaded 5 column) March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 22

23. Administering CAPA Level I Up to 5 cues given Up to 3 prompts given If no response after verbal/gestural prompt, then modeled prompt only If no response after modeled prompt, then hand- over-hand Student must answer independently after hand- over-hand or any prompt March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop Quiz Questions 3 & 4

24. Cue/Directions Level I (see rubric HO) March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 24 1.Give cue/directions –Wait minimum of 5 seconds for verbal response; Wait minimum of 7 seconds for physical response –If student responds (correct or not), STOP. 2.Repeat cue/directions ONCE –Wait minimum of 5 seconds for verbal response; Wait minimum of 7 seconds for physical response –If student responds (correct or not), STOP.

25. Cue/Directions Level I Prompts (see rubric HO) March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 25 3. Verbal/gestural prompt; repeat cue/directions –Wait –If student responds (correct or not), STOP. 4. Modeled prompt; reset objects; repeat cue/directions –Wait –If student responds (correct or not) or does not respond, STOP. 5. Hand-over-hand prompt; reset objects; repeat cue/directions –Wait –If student responds (correct or not) or does not respond, STOP. Quiz Question #5

26. CAPA Answer Circles Level I only: score of 5 is possible March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 26 Quiz Question #7

27. March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 27 Scoring CAPA Level I If wrong answer given, score 1 Correct answer with first or second cue, score 5 Correct answer with verbal / gestural prompt, score 4 Correct with modeled prompt, score 3 Correct with hand-over-hand prompt, score 2 Orients to task, score 1 No response at any time, score NR Quiz Questions 8 & 9

28. PRACTICE In diads – partners take turns explaining to each other how to administer Level I. Reference the Level 1 rubric chart. March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 28

29.  Watch, score & discuss Level 1 video samples  Triad table practice (roles: student – examiner – 2 nd rater) each person practices each role using provided Level 1 sample tasks Practice Scoring CAPA Level I March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 29

30. Scoring practice March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 30

31. Administering CAPA Levels II–V Give cue Repeat cue only once, if necessary NO prompts are given March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop Quiz Question # 6

32. Cue/Directions Levels II–V (see rubric HO) Cue/direction –Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response –If student responds (correct or not), STOP. Repeat cue/direction –Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response – STOP Practice: in diads - partners explain to each other how to administer Levels II-V. March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 32

33. Practice scoring CAPA Level II-III-IV-V March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 33  Watch, score & discuss level 2, 3, 4 & 5 sample videos  Triad table practice (roles: student – examiner – 2 nd rater) each person practices each role using provided sample tasks

34. Scoring practice March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 34

35. After the Test (see examiner’s manual p. 31) Sign and date each completed answer document, verifying that you have been trained in the CAPA administration. Work with your STAR test site coordinator to ensure that any marks other than marks within answer circles have been erased. –Cleaning up the answer documents is to be done only with the STAR test site coordinator and/or principal/school administrator. –Do not erase anything unless you are working directly with the STAR coordinator or principal/school administrator. Before returning materials to the STAR test site coordinator, mark the appropriate circles in sections A2 and A4 on the back cover of students’ test booklets/answer documents where appropriate and confirm with the test site coordinator. See Appendix D, last part on “Special Conditions, A2” and “English Learner Test Variations, A4.” Completed CAPA answer documents are secure materials. Pack and return all answer documents and CAPA Examiner’s Manuals to your STAR test site coordinator immediately after testing is completed. Must be returned to AEP by Wednesday May 15 th March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 35

36. After-test Procedures Section A2 Special Conditions See examiner’s manual p. 111 & sample answer doc March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 36 A Student was absent for regular and make-up testing. E Student was not tested because of a significant medical emergency F Student became ill while taking the test; had to leave the room, and was unable to return and complete the test. L Student enrolled after first day of testing and was given this test. M Student was enrolled on first day of testing and took one or more tests then moved before this test was administered or completed. P Student not tested by parent/guardian request. (note – parent's written request should be given to your site STAR coordinator) T Student enrolled on the first day of testing and was not given this test because a staff member verified that the student had taken the test at a previous school YThis document replaces a lost or destroyed answer document.

37. After-test Procedures See examiner’s manual & answer doc. Section A4 – English Learner Test Variations –A: Student given directions in language other than English (includes use of ASL) Complete name, sign, date, and mark “Examiner” or “Observer” to attest training received March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 37 Quiz Question # 10

38. Review & Questions Words of wisdom from those experienced with CAPA? Any questions ??? March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 38

39. For more information go to: http://www.cde.ca.gov/ta/tg/sr/capa.asp http://www.californiatac.org/about/capa/ SJUSD Countdown to CAPA website: http://www.sanjuan.edu/LaurelRuff.cfm?subpage=69739 March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop 39

40. Quiz Answers 1. a 2. d 3. a 4. c 5. d 6. b 7. a 8. d 9. b 10. b March 2014SJUSD CAPA Examiner / 2 nd Rater Workshop