1. South Carolina Alternate Assessment DTC-Alt Pretest Workshop 2014-15 South Carolina Department of Education American Institutes for Research November 2014

2. Training Topics Review of 2014 Administration Results SC-Alt 2015 Administration –Important Testing Procedures –Administration and Scoring Fidelity –Second Rater Administration Update SC-Alt Test Administrator Training New Alternate Assessments Precode 2

3. Review of the 2014 Administration Results 3

4. Participation 3431 students tested –Increase of 1 student from 2013 –3.4% increase in students with autism –5.5 % increase in students with mild ID –1.7% increase in students with LD –3.3 % decrease in students with moderate ID –3.2 % decrease in students with severe ID –9.8 % decrease in students with DD 4

5. Performance ELA 83.5% Proficient (levels 3 and 4) –LD 94.6% –Mild ID 98.4% Math 78.6% Proficient (levels 3 and 4) –LD 93% –Mild ID 96.6% 5

6. One Percent Rule 24 districts exceeded the 1% rule – Ranges from 1.2% to 3.2% 6

7. 1% Rule and LD Students Most districts 0% of LD students tested with SC-Alt One district 8.1% of LD students tested with SC-Alt Another district 4.2% of LD students tested with SC-Alt 7

8. SC-Alt 2015 Administration 8

9. Administration Window March 2 - April 24 Testing materials will arrive in the districts by February 20 9

10. Procedural Guidelines Test Administration Manual (TAM) District Test Coordinator’s Supplement Manual Score Report User’s Guide 10

11. SC-Alt Spring 2015 Content to be Assessed Science (Elementary and Middle School)Science (Elementary and Middle School) Social StudiesSocial Studies Grades 4-8 (all students)Grades 4-8 (all students) 11

12. for 2015 SC-Alt Science and Social Studies SC-Alt Science and Social Studies 12 tasks 12 tasks “Responding Successfully” redefined “Responding Successfully” redefined Six points instead of three points Six points instead of three points New SC-Alt Test Administrator Fields in Precode New SC-Alt Test Administrator Fields in Precode 12

13. Resources South Carolina Alternate Assessment Social Studies Instructional and Assessment Guide –South Carolina Alternate Assessment Social Studies Instructional and Assessment GuideSouth Carolina Alternate Assessment Social Studies Instructional and Assessment Guide South Carolina Alternate Assessment Science Instructional and Assessment Guide –In process 13

14. SC-Alt Testing Procedures 14

15. Grade-Band Form Assignments (Elementary and Middle) Students are assigned to SC-Alt grade-band forms on the basis of their age as of September 1, 2014, as pre-coded in the PowerSchool data base.Students are assigned to SC-Alt grade-band forms on the basis of their age as of September 1, 2014, as pre-coded in the PowerSchool data base. For students who do not have a pre-assigned form, refer to the Age and Birth Date Reference Sheet in the 2015 TAM (Appendix B) or on the SCDE website to determine the correct form.For students who do not have a pre-assigned form, refer to the Age and Birth Date Reference Sheet in the 2015 TAM (Appendix B) or on the SCDE website to determine the correct form. 15

16. Test Security Regulations SC-Alt is subject to SC Test Security Regulations –Test books and materials are secure –Materials must be kept in secure place when not in use –Test books may not be copied or reproduced –All Test Administrators and monitors must sign Agreement to Maintain Test Security and Confidentiality –A copy of the Test Security Regulations is located in Appendix A of the TAM and on the Department website –Test Security Violations must be reported using the Test Security Violation Action Form in the TAM 16

17. Secure File Transfer (sFTP) AIR uses an sFTP site to electronically send secure materials to the school districts You will be notified whenever pertinent files or information are posted on the sFTP site for your access such as: –Second Rater Roster –District Roster of Students Taking SC-Alt –Secure Video Clips for Training –Training Webinar for the District Training –District Data Files –Demographic Correction Forms 17

18. Packaging of Test Materials All test materials for each grade band are bundled into one Test Administrator Kit. Test Administrators receive one kit for each grade band that they are assessing. Each kit contains a serial number. This number is also included in the ancillary documents packed in the school and district boxes. 18

19. Test Administrator Kit Test Booklets Print Manipulatives Physical Manipulatives Reading Passages 19

20. Other Items Not Included in the TA Kits Test Administrator Security Checklists Student Rosters Answer Folders (by grade-band form, color coded) Scoring Worksheets Precoded Bar Code Labels 20

21. Braille Materials Teachers with students who need braille and tactile graphic materials SHOULD use the Braille Order Form in the TAM (Appendix N) to request these materials. –TAs submit the form to the DTC-Alt who forwards it to AIR. –A list of tasks with braille and/or tactile graphic materials is in the TAM Appendix Q. –Braille Order Forms are also provided in the district box. 21

22. Administration and Scoring Fidelity Monitors Second Raters 22

23. Monitors Monitors must be trained – See TAM pages 6-7 for training requirements Observe all assessment sessions and verify the use of proper procedures and authenticity of student responses –Sign the Test Administrator Security Affidavit (TAM Appendix E) Sign Agreement to Maintain Test Security and Confidentiality (TAM Appendix D) –Copies of the agreement will be provided in the school box 23

24. Second Rater Procedure A trained SC-Alt Administrator observes and independently scores an administration to document administration and scoring fidelity based on a scientific sample. –All districts are sampled –Sampling is implemented by teacher and student –Teachers are sampled according to proportions of students in their district –Approximately 1/3 of teachers and 10% of students will be sampled 24

25. Second Rater Selection Teachers are selected to have a second rater observe an administration based on the January 2015 Precode file. –Accurate precoding of the SC-Alt Test Administrator field is important to ensure accurate assignment. DTCs-Alt select and assign the second rater to observe the administration. Second rater administrations for 2015 will be conducted in social studies only. 25

26. Second Rater Qualifications Must meet the Test Administrator criteria: Certified teacher Administrator (e.g., school administrator, district level special education consultant, or other administrator) Related services personnel Must participate in District Level Test Administration Training 26

27. Second Rater Timeline January 29AIR uploads the roster of all SC-Alt students and of students selected to have second rater administration to district sFTP sites January 29-February 20DTCs-Alt notify AIR Helpdesk of any changes that need to be made January 30Second Rater Procedures and Instructions Memorandum to the districts with district training materials February 20Second rater kits arrive in district with SC-Alt test materials 27

28. Second Rater Changes Please notify AIR of any changes to the Second Rater roster by Feb. 20. If it is necessary to revise your district’s second rater roster, the new test booklets and second rater answer folders will arrive separately from the other test materials. 28

29. Return Procedures Review the DTC-Alt Supplement for return shipping procedures. Review the Appendices J and K of the TAM for additional information 29

30. Return Procedures Helpful Hints Make sure all responses have been transferred from the Scoring Worksheet to the Answer Folder. Make sure all signatures are on the Test Administrator Security Affidavit. Use Student Rosters to verify that all appropriate students were assessed. Make sure you have received all TA Kits and that the test booklets and other materials are included. 30

31. More Helpful Hints Follow up on any missing materials. Review Answer Folders for completeness of coding. Do not put sticky notes on answer folders or include other notes about why a student was not tested. When a student was not tested, provide documentation on the Students Not Tested Report (Office of Research and Data Management). 31

32. Clarification on Non-Valid Administrations Students considered “Not Tested” 32

33. Non-Valid Administrations Failure to complete Test Administrator Security Affidavit (all signatures) Assessment of student with wrong form Failure to administer all required tasks as specified in the Directions for Determining the Starting and Concluding Tasks Assessment of student beginning with wrong starting task (not following drop back rule if student does not obtain 3 points on the starting task) Failure to transfer item scores from the worksheet to the answer folder 33

34. Test Administrator Training 34

35. Test Administrator Requirements Test Administrators must be trained. A Test Administrator must be a certified employee of the district or another individual who meets the criteria specified in the TAM (page 6) and approved by the DTC-Alt. 35

36. Test Administrator Training Regional Workshops –Teachers/Test Administrators who did not administer the SC-Alt in spring 2013 or 2014. –One additional district representative District Level Training –All Teachers/Test Administrators Experienced Teachers/Test Administrators who administered SC-Alt in spring 2013 or 2014, and Teachers/Test Administrators who attended the regional workshops –Second raters 36

37. Regional Workshops January 26 January 27 January 28 January 29 January 30 Columbia Greenville Florence Charleston 37

38. District Level Training To be conducted by DTC-Alt or Designee Training Window- February 2-27 Approximately two and a half hours 38

39. Training Materials Test Administration Manuals (TAMs) DTC-Alt Supplement Training Tasks Participant Sign-in Sheet Return Envelope These materials will be shipped by AIR to arrive in the district by January 30 39

40. Training Materials (cont.) Webinar presentation – Administration procedures – Scoring procedures – Information on downloading the webinar from the your district’s AIR sFTP site will be provided to DTCs-Alt prior to the training window Optional video clips of standards based instruction and test administrations –The video clips will be posted to your district’s sFTP site for your access 40

41. Training Materials (cont.) Handouts to Be Downloaded from the SCDE Website –Training Power Point –Administration and Scoring Training Acknowledgement Forms –Agreement to Maintain Test Security and Confidentiality Forms –Training Evaluation Forms 41

42. Training Topics District information and expected communication procedures Procedures for receiving materials Importance of immediate review of materials –Remind TAs to notify the DTC-Alt of missing materials or the need for additional materials 42

43. Training Topics (cont.) Test security regulations –Have the Test Administrators sign the Agreement to Maintain Test Security Use of monitors and any procedures in place in the district for obtaining or assigning monitors District second-rater procedures Return procedures TAM (Appendices J and K) 43

44. Training Activities Administering and Scoring SC-Alt Webinar –Download from AIR sFTP site Scoring Practice –Allow about 15 minutes for teachers to practice in pairs administering and scoring the sample tasks in the Training Task Booklet –Facilitate discussion and questions Training Videotapes –Examples of actual assessments and instruction linked to South Carolina State Standards –Download from AIR sFTP site 44

45. Training At the completion of the training have the Test Administrators: –Sign the Administration and Scoring Training Acknowledgement Form –Complete the Training Evaluation Form 45

46. Collect and Maintain in the District Agreement to Maintain Test Security and Confidentiality Forms Administration and Scoring Training Acknowledgement Forms One copy of the Participant Sign-in Sheet Scoring Worksheet (destroy after training) 46

47. Materials to be Returned Use envelope in training materials shipment to return the following materials to AIR: Training Evaluations Participant Sign-in Sheets 47

48. Final Important Dates April 24, 2015 –Last day of testing April 29, 2015 –Last day to ship materials to contractor –Shipping the materials on this date ensures that the materials are received by the contractor on May 1, 2015. 48

49. New Alternate Assessments 2015 49

50. New Alternate Assessments Alternate ACCESS for English Language Learners (ELLs) National Center State Collaborative (NCSC) Alternate Assessment in ELA and Math –Aligned to Common Core State Standards –Computer delivered 50

51. Alternate ACCESS English Language Proficiency Exam ELL students who are eligible for alternate assessment Ages commensurate with grades 1-12 Kindergarten age students take the general ACCESS test http://www.wida.us/assessment/alternateaccess.aspx 51

52. Test Dates February 17- March 30, 2015 52

53. NCSC Alternate Assessment Aligned to the Common Core State Standards in ELA and Math Grade level specific Online Test Administrator Training edComputer Deliver ed 53

54. NCSC ELA and Math Assessment Test Dates Pilot Test October 20-November 14, 2014 Operational Test March 30- May 14, 2015 54

55. Purpose of Pilot –Collect data about how students interact with the items –Gather information about how the items function –Examine test administration procedures and conditions –Evaluate test administration training –Review item scoring processes and procedures –Receive input from teachers 55

56. NCSC Instructional Resources An instructional resources wiki has been created to host materials that educators will need to deliver instruction aligned to the Common Core State Standards (CCSS). https://wiki.ncscpartners.org/mediawiki/index.php/Main_Page 56

57. ts Guidance for IEP Teams on Determining Participation in the South Carolina Alternate Assessments http://ed.sc.gov/agency/programs- services/48/documents/SC- AltParticGuidanceForIEPteams.pdfhttp://ed.sc.gov/agency/programs- services/48/documents/SC- AltParticGuidanceForIEPteams.pdf 57

58. 2014-15 SC-Alt Precoding 58

59. Why Accurate Precoding is So Important Precode is used to order and sort test SC-Alt materials and to pre-populate student demographic information. Test Administrator’s name determines SC-Alt materials distribution and second rater assignments. –PowerSchool now has fields for the test administrator’s name! The Home room field is no longer being used for SC-Alt. Reduces additional material orders Reduces errors related to: –Student demographic coding –SC-Alt form assignment 59

60. Where to Find the Precode Manual Precode Training http://ed.sc.gov/agency/ programs-services/46/ 60

61. Importance of the Date of Birth The grade level the student tests in is always based on the student’s age as of September 1 of the current school year. Focus on the correctness of the date of birth. The state will calculate the age and determine the grade tested. You may use Appendix B in the Precode Manual as a reference sheet to determine the grade the state will assign to the student. 61

62. Precode Tab in PowerSchool 62

63. Alternate Assessment Eligibility A new Yes/No field replaces last year’s alternate assessment codes. Select ‘Y’ if the student is eligible regardless of age or grade designation. (You are no longer asked to determine the grade. The state will calculate the age and determine the grade.) 63

64. Alternate Assessment Test Administrator Name Fields For the same test administrator, be consistent across students. Use the same capitalization, spacing, and punctuation. 64

65. The new Alternate Assessment Exception field should be ignored for 2014-15. It will be important for 2015-16. 65

66. Precode Questions Aaron Brown arbrown@ed.sc.gov 66

67. Anne Mruz amruz@ed.sc.gov 803-734-8034 South Carolina Department of Education Office of Assessment Suzanne Swaffield sswaffie@ed.sc.gov 803-734-8274 Jill Christmus mchristmus@ed.sc.gov 803-734-8048 67

68. American Institutes for Research Celine Tobal ctobal@air.org ctobal@air.org 877-231-7789 68