1. Measuring the Power of Learning.™ 2015–16 CAASPP Test Administrator (SCHOOL) Spring 2016 California Assessment of Student Performance and Progress (CAASPP)

2. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 2 A New System With a New Purpose Transition from STAR to CAASPP means more than changing standards and testing technology: THEN (STAR): Administered end of year with accountability solely as the primary purpose NOW (CAASPP): An integrated year-round system with a primary purpose of improving teaching and learning

3. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 3 Summative Assessment: One Part of an Integrated System

4. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 4 A New Role for Assessment: Supporting Teaching and Learning Rather than a result, test scores are starting points to identify strengths and needs and help set learning goals. The Smarter Balanced Digital Library and Interim Assessments are designed to help schools achieve goals for learning, monitor progress, and adjust instruction throughout the year.

5. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 5 The Smarter Balanced Summative Assessments consist of the following: –English Language Arts/Literacy (ELA) and mathematics tests –Includes computer adaptive portion of the test, a classroom activity, AND a performance task in each content area The California Alternate Assessments (CAAs) consist of the following: –English Language Arts and mathematics tests for students with significant cognitive disabilities Student Participation: General

6. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 6 All students in grades 3–8 and grade 11 take the Smarter Balanced Summative Assessments with the following exceptions: – Students enrolled in or assigned to grades 3–8 and grade 11 whose IEP team designates the use of the California Alternate Assessments (CAAs) for ELA and mathematics – English learners who have been enrolled in a school in the United States less than 12 months (ELA only) Student Participation: General

7. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 7 Student Participation: Early Assessment Program The Early Assessment Program (EAP) uses the high school Smarter Balanced Summative Assessments for ELA and mathematics. Students taking the Smarter Balanced Summative Assessments in high school may choose to release their test scores to the California State University (CSU) and participating California Community Colleges at the end of the computer adaptive tests. Students who do not authorize the release of their test scores to CSU and CCC at the time of testing may need to provide a copy of the CAASPP score report to the campus, upon request.

8. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 8 Pursuant to California Code of Regulations, Title 5, Section 852: Each year the local educational agencies (LEAs) are required to notify parents or guardians of their pupil's participation in the CAASPP tests. In addition, LEAs are required to inform parents of their right to exempt their child from taking the CAASPP tests. –Parents must annually submit a written request specifying the tests to be exempted. Importance of Informing Parents and Guardians About Testing

9. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 9 Importance of Informing Parents and Guardians About Testing Inform parents and guardians about testing to: –Seek input on designated supports that the student may need during testing. –Coordinate with the student’s IEP team to determine the most appropriate test for the student. –Provide an opportunity for the parent/guardian to submit a testing exemption. –Communicate any schedule changes to the normal school schedule. –Obtain updates to student demographic information that may impact testing or score reporting.

10. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 10 Smarter Balanced Summative Assessments Computer adaptive test (CAT): Students complete the CAT portion of the assessment for both ELA and mathematics. The CAT includes a wide variety of question types. As a student progresses, the difficulty of questions is adjusted on the basis of the student’s responses. –A student who answers a question correctly will receive a more challenging question –An incorrect answer will generate an easier question

11. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 11 Smarter Balanced Summative Assessments Classroom Activity for ELA and mathematics: Educators from across the Smarter Balanced Assessment Consortium conducted a review of the classroom activity. –To determine if the Smarter Balanced performance tasks (PT) in English Language arts/literacy (ELA) and mathematics contained sufficient explanation and context to stand on their own without the administration of a classroom activity.

12. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 12 Smarter Balanced Summative Assessments Classroom Activity for ELA and mathematics: Smarter Balanced determined that the vast majority of performance tasks contain sufficient explanation and context to be administered without requiring the classroom activity. –Based on this result, Smarter Balanced provided states with the flexibility to either continue requiring the administration of the classroom activity, make the administration of the classroom activity optional, or discontinue the administration the classroom activity. –Any Performance Task that was identified as not containing sufficient explanation and context to be administered without a classroom activity has been removed from the 2015–16 Smarter Balanced tests.

13. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 13 Smarter Balanced Summative Assessments Classroom Activity for ELA and mathematics: California will utilize the 2015–16 year as a transition year and will continue to assign classroom activities in ELA and mathematics. –In 2015–16, failure to administer the classroom activity is not considered a testing incident. –The CDE will not require LEAs to report failure to administer the classroom activity in the Security and Test Administration Incident Reporting System (STAIRS).

14. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 14 Smarter Balanced Summative Assessments Performance Task: Students complete a performance task for both ELA and mathematics. The Performance Task is designed to provide students with an opportunity to demonstrate their ability to apply their knowledge and higher- order thinking skills to explore and analyze a complex, real-world scenario.

15. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 15 What’s New for 2015–16 User roles Secure browser used for administration of CAAs Validation of selected test administration window Validation rules for CAAs, IEP indicator, and accommodations Process for requesting unlisted resources (previously called “individualized aids”) Enrollment grade cutoff date No accountability consequence for classroom activity not given to students

16. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 16 What’s New for 2015–16 Security and Test Administration Incident Reporting System (STAIRS) Deadline for condition codes and Appeals Demographic snapshot Assessment Target Reports Faster initial Student Score Reports Student Score Reports available in Spanish Notification e-mails for scoring and reporting

17. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 17 What’s New for 2015–16 Changes to http://www.caaspp.orghttp://www.caaspp.org

18. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 18 What’s New for 2015–16 Changes to http://www.caaspp.orghttp://www.caaspp.org

19. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 19 What’s New for 2015–16 Changes to http://www.caaspp.orghttp://www.caaspp.org

20. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 20 Test Administrator Responsibilities Read and sign the CAASPP Test Security Affidavit. Complete training and review all Smarter Balanced policy and administration documents prior to administering any Smarter Balanced assessments. Review student information prior to testing to ensure that the correct student receives the proper test with the appropriate supports and test settings. Administer the Smarter Balanced Summative Assessments. Report all potential test security incidents to the test site coordinator and LEA CAASPP coordinator in a manner consistent with LEA and state policies.

21. Measuring the Power of Learning.™ Practice Tests and Training Tests

22. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 22 Preparing Students and Staff There are multiple ways to prepare students and staff for the summative assessments: Smarter Balanced Practice Tests Smarter Balanced Training Tests New: CAA Training Tests, coming soon Note: Practice tests for the CAAs are not available for 2015–16.

23. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 23 Important Notes About Practice and Training Tests Practice Tests and Training Tests: Do not assess all of the standards that will be in the operational tests. Do not predict or gauge a student’s success on the operational assessments. Do not produce overall scores.

24. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 24 Smarter Balanced Practice Tests vs. Training Tests Practice TestsTraining Tests Purpose Provide students with a grade specific testing experience similar in structure and format to the summative assessments Provide students with an opportunity to quickly become familiar with the software and interface features Grade Levels Each grade: 3–8, 11 Grade bands: 3–5 6–8 High school Number and Types of Questions Approximately 30 questions in ELA and 30 questions in mathematics per grade level; includes 1 ELA Performance Task and 1 mathematics Performance Task per grade level Approximately 15 questions per grade band (6 in ELA and 8–9 in mathematics); Performance Tasks are not available Universal Tools, Designated Supports, and Accommodations All Scoring Tests are not scored, however answer keys and scoring rubrics are availableTests are not scored

25. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 25 CAAs Training Tests Training Tests for CAAs Purpose Provide students with an opportunity to quickly become familiar with the test delivery system, question types, and interactions provided in the DFAs Grade Levels One test each for ELA and mathematics Number and Types of Questions Approximately 5–10 questions for each content area Universal Tools, Designated Supports, and Accommodations All that are available for CAAs ScoringTests are not scored

26. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 26 Purpose of the Smarter Balanced Practice Tests Allow students and administrators to become familiar with: The experience of a grade-level assessment A variety of grade-specific questions and difficulty levels Performance tasks The format and structure of the operational assessments

27. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 27 About the Smarter Balanced Practice Tests Practice Test are available in each grade level for grades 3– 8 and grade 11 for ELA and mathematics. Each Practice Test contains approximately 30 questions. Performance tasks are available for both ELA and mathematics. Scoring rubrics and answers are available on the Test Administrators Resource Web page at http://www.caaspp.org/ta-resources/index.html. http://www.caaspp.org/ta-resources/index.html All universal tools, designated supports, and accommodations are available. –Text-to-speech only available through secure browser. –Print-on-demand only available in proctored session.

28. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 28 Designed to try out the universal tools, designated supports, and accommodations to establish the most optimal test setting experience for the student Allow students and administrators to become familiar with the test delivery system and interface features Allow students to become familiar with: –Accessing the tests (log on process) –The testing software –The navigational tools –Embedded supports Purpose of the Smarter Balanced and CAAs Training Tests

29. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 29 About the Smarter Balanced Training Tests Training Tests are available by grade bands for grades 3–5, grades 6–8, and high school. Each Training Test contains approximately 14 or 15 questions: –6 ELA questions –8 or 9 mathematics questions There are no performance tasks included in the Training Tests. There are no scoring rubrics or answer keys. All universal tools, designated supports, and accommodations are available. –Text-to-speech only available through secure browser. –Print-on-demand only available in proctored session.

30. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 30 Accessing the Practice and Training Tests There are two means for accessing the Practice and Training Tests: 1.Through http://www.caaspp.org on a Web browserhttp://www.caaspp.org 2.Through the secure browser, which simulates operational online testing environment. Test administrators may create test sessions for the Practice Tests or Training Tests on the Test Administrator Practice and Training Site. −Students may return to a Practice Test and/or Training Test session.

31. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 31 Accessing the Practice and Training Tests 3 Students and parents who wish to access the Practice Test and/or Test via an Internet browser will select the button below 2 1

32. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 32 Practice and Training Tests Resources Test Administrator (TA) Resources for the Smarter Balanced Practice and Training Tests http://www.caaspp.org/ta-resources/practice- training.html

33. Measuring the Power of Learning.™ Test Administration Windows and Setup

34. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 34 Test Administration Windows Testing windows for 2015–16 Smarter Balanced Summative Assessments: –Grades 3–8 for ELA and mathematics  April 4 through June 2 –Grades 11 for ELA and mathematics  April 11 through June 2 (Note: Grade 11 scores used for Early Assessment Program (EAP) purposes.) Testing windows for 2015–16 Science (CST/CMA/CAPA)  April 6 through May 10 –Testing window for 2015–16 CAAs  April 11 through June 2

35. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 35 Test Eligibility Smarter Balanced ELA and Mathematics Default test assignment for grades 3–8 and grade 11 Not taking the CAAs CST for Science Default science test assignment for grades 5, 8 and 10 Not taking CAA (grades 5 and 8) or CAPA Science CMA for Science Grade 5, 8, and 10 Has IEP plan and IEP team determined CMA as most appropriate test Not taking for CAA (grades 5 and 8), CST or CAPA Science CAA ELA and Mathematics, CAPA Science Must be designated as having severe cognitive disability Must have an IE and IEP team determined that CAA/CAPA Science as the most appropriate tests

36. Measuring the Power of Learning.™ Accessibility Supports

37. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 37 Accessibility Supports Universal Tools: –Available to all; based on student preference and selection (e.g., strikethrough, highlighter) Designated Supports: –Available to all; need to be indicated by an educator or guardian (e.g., color contrast, read aloud, glossary, magnification) Accommodations: −Based on IEPs or Section 504 plan (e.g., American Sign Language, scribe)

38. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 38 Accessibility Supports The online assessments include embedded and non-embedded accessibility supports: –Embedded: part of the computer administration (e.g., digital notepad, calculator) –Non-embedded: provided outside the computer administration (e.g., scratch paper, multiplication table)

39. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 39 Accessibility Supports

40. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 40 Accessibility Supports *Must be activated in the test delivery system. **Print on demand cannot be activated in TOMS. If a student needs print on demand for questions and/or questions and stimuli, contact the CalTAC. EmbeddedNon-Embedded Designated SupportAccommodationDesignated SupportAccommodation Color contrast American Sign Language (ELA listening and math questions) Bilingual dictionary (ELA Performance Task full writes) Abacus MaskingBrailleColor contrastAlternate response options Text-to-speech (ELA and math questions) Closed captioning (ELA listening questions) Color overlay Calculator (math—allowed questions Grades 6–8, 11) Translations (glossaries) (math questions) Streamlined interfaceMagnification Multiplication table (math - Grades 4–8, 11) Translations (stacked) and Translated test directions ( for math - Spanish) Text-to-speech (ELA reading passages) Noise buffersPrint on demand** Print size Read aloud (ELA and math questions) Read aloud passages (ELA) Permissive mode Scribe (ELA non-writing and math questions) Scribe (ELA Performance Task full write) Turn off any universal tools* Separate settingSpeech-to-text Read aloud in SpanishUnlisted resources Translation (glossaries) (only paper pencil math tests) Additional alternate assessment instructional supports (CAAs only) Translated test directions (for online ELA and math questions)

41. Measuring the Power of Learning.™ Test Administration

42. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 42 Systems and Processes for Online Administration Test Administrator Interface & Student Testing Site Administer online Smarter Balanced Assessments Administer CAAs Test Administrator Interface & Student Testing Site Administer online Smarter Balanced Assessments Administer CAAs TOMS Set up test administration windows Verify student demographic data Configure online test settings (designated supports and accommodations) TOMS Set up test administration windows Verify student demographic data Configure online test settings (designated supports and accommodations) CALPADS (California Longitudinal Pupil Achievement Data System) Manage student demographic data CALPADS (California Longitudinal Pupil Achievement Data System) Manage student demographic data 123

43. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 43 Scheduling Testing Time Estimated testing times: Content AreaGrades Computer Adaptive Test (CAT) questions hrs : mins Performance Task (PT) hrs : mins Total hrs : mins Classroom Activity (administered prior to the PT)* hrs : mins Total hrs : mins English Language Arts/Literacy 3–51:302:003:30:304:00 6–81:302:003:30:304:00 112:00 4:00:304:30 Mathematics 3–51:301:002:30:303:00 6–82:001:003:00:303:30 112:001:303:30:304:00 Both 3–53:00 6:001:007:00 6–83:303:006:301:007:30 114:003:307:301:008:30

44. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 44 Scheduling Testing Time INSERT YOUR SCHEDULE HERE

45. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 45 Establishing Appropriate Testing Conditions Testing students in classroom-sized groups is preferable: –Reduces test fear and anxiety –Facilitates monitoring and control for test administrators Room should have good lighting and ventilation, and be free of noise and interruptions. Remove or cover displayed information (on bulletin boards, chalkboards, and dry-erase boards, etc.) that may be used by students to help answer questions: –Rubrics, vocabulary charts, student work, posters, graphs, charts, etc.

46. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 46 Establishing Appropriate Testing Conditions Make appropriate seating arrangements prior to test administration: –Students should be seated so that they cannot view the answers of others. Establish procedures to maintain a quiet testing environment: –Remember that some students may finish more quickly than others.

47. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 47 Establishing Appropriate Testing Conditions Cell phones or other electronic devices are not allowed to be used during testing (e.g., they must be turned off and put away). Post an “Unauthorized Electronic Devices May Not Be Used at Any Time During the Testing Session” sign so that it is clearly visible to all students. Place a “TESTING—DO NOT DISTURB” sign on the door.

48. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 48 General Test Rules Students must answer all test questions on a page (i.e., screen) before moving on to the next page. Students may not return to a test segment once it has been completed and submitted. Students must answer all test questions before the test can be submitted. Students may not return to a test once it has been completed and submitted. Test administrators must follow the “SAY” script exactly each time a test session is administered. −Refer to the “SAY” boxes of the Online Test Administration Manual and/or Online Directions for Administration.

49. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 49 Administering a Test Session 1.The test administrator logs on to the Test Administrator Interface from http://www.caaspp.org on a standard Web browser.http://www.caaspp.org

50. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 50 Administering a Test Session 2.The test administrator selects the test category or the grade level and content area.

51. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 51 Administering a Test Session 3.The test administrator selects the tests to administer. –Additional tests can be added to a session; you will receive a confirmation message box. 4.The test administrator starts a test session.

52. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 52 Administering a Test Session 5.The test administrator informs students of the test Session ID. –Write or display it clearly in a place all students can see. –Session IDs are automatically generated upon selecting the Start Session button. Additional tests can be added to a session; a confirmation message box confirms adding tests to a session.

53. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 53 Administering a Test Session Test administrators need to distribute Student Logon Information providing students with their Statewide Student Identifier (SSID) and confirmation code (student first name in CALPADS) for logon along with the Session ID. −The information may be provided on a card or piece of paper (i.e., login ticket). −Additional information can be included on the login ticket. Important: Student personal information is secure and must be collected and securely stored at the end of a test session, then securely destroyed at the end of the test administration.

54. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 54 Administering a Test Session 6.Students log on through the secure browser. –Recommended: Secure browsers are already launched on testing devices before students sit down to test. −To log on, students need:  First Name (Confirmation Code): Student’s legal first name as spelled in CALPADS  State-SSID: “CA” followed by a hyphen “-” and the student’s SSID  Session ID: Test administrator -generated Session ID

55. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 55 Administering a Test Session 7.Students verify their identity. –After logging on, students will see the “Is This You?” screen. –Students should select Yes to continue if the information on the screen is correct.

56. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 56 Administering a Test Session 8.Student selects the test. –All grade-level tests that the student is eligible to take are displayed. –Only the tests that the test administrator has selected for the test session and those that have not been completed are selectable by students. Note: Only the tests that have been selected by the test administrator will appear active. Others will be grayed out.

57. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 57 Administering a Test Session 9.Upon selecting a test, students wait for test administrator approval. 10.As students select tests, the test administrator can see approvals populate in the Approvals queue of the Test Administrator Interface.

58. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 58 Administering a Test Session 11.The test administrator selects the Approvals (#) button to access the Approvals and Student Test Settings screen.

59. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 59 Administering a Test Session 12.The test administrator verifies that the students have selected the appropriate test and reviews the students’ test settings by selecting See Details button next to each student.

60. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 60 Administering a Test Session

61. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 61 Administering a Test Session 13.The test administrator selects Set to confirm the current test settings and return to the list of students awaiting approval. The test administrator still must approve the student for testing OR 14.The test administrator selects Set & Approve to establish the existing settings and approve the student for testing. Note: If a student’s test settings are incorrect, test administrators should deny the student, contact the LEA CAASPP coordinator or test site coordinator to correct the test settings in TOMS, and test the student at a later time.

62. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 62 Administering a Test Session 15.Upon reviewing test settings for all students, the test administrator approves students to test on the Approvals and Student Test Settings screen. –Select Approve to approve a specific student for testing. –Select Approve All Students to approve all students.

63. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 63 Administering a Test Session 16.After the test administrator has approved a student for testing, the student verifies the test information and settings. The student will select Yes, Start My Test to begin testing or No if the settings are incorrect.

64. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 64 Administering a Test Session 17.If a student has a text-to-speech accommodation or is taking a test with ELA listening questions, he or she will verify the audio checks through headphones. Text-to-speech audio check Test with listening questions audio check

65. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 65 Administering a Test Session 18.Finally, students will see the Test Instructions and Help page before they begin testing. Students will select Begin Test Now to begin testing.

66. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 66 Monitoring Student Progress Test administrators can monitor student testing through the Students in Your Test Session table on the Test Administrator Interface: –Displays students who have logged in and been approved for testing.

67. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 67 Pausing Tests Test administrators may pause an individual student’s test in the Students in Your Test Session table. −This will not affect other students’ tests. −There are different pausing rules for the CAAs.

68. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 68 General Pause Rules If there is a technical issue (e.g., power outage or network failure), students will be logged out, and the tests will automatically be paused. If a test is paused, the student must log in again to resume testing. Highlighted text is preserved during test sessions. Student comments entered on a notepad are preserved.

69. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 69 Smarter Balanced Pause Rules: Computer Adaptive Test If a CAT is paused for more than 20 minutes, the student is: −Presented with the test page (i.e., screen) containing the test question he or she was last working on (if the page contains at least 1 unanswered question) OR presented with the next test page (if all questions on the previous test page were answered) −Not permitted to review or change any test questions on previous test pages If a CAT is paused for less than 20 minutes, the student is: –Presented with the test question or passage he or she was working on when the test was paused –Permitted to answer previously shown questions within a segment

70. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 70 Pause Rules: Performance Task There are no pause rules for Performance Tasks. −Even if a Performance Task is paused for more than 20 minutes, the student can return to the current section and continue. ELA Performance Tasks are divided into two parts. −After a student completes the first part, he or she cannot return to it.

71. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 71 Test Timeout Due to Inactivity As a security measure, students are automatically logged out of the test after 30 minutes of inactivity. Activity means: −Selecting an answer −Using a navigation option in the test (e.g., selecting Next or Back, using the Questions drop-down list) Note: Moving the mouse or selecting an empty space on the screen is not considered activity. Before the system logs out, a warning message is displayed.

72. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 72 Stopping an Entire Test Session Test administrators can stop a test session (and therefore, pause tests for all students in the session) –Select the Stop Session button in the upper-right corner of the Test Administrator Interface. –An “Important!” box will appear, requesting verification to end the session and log students out. –Select OK to continue or Cancel to keep the test session open.

73. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 73 Reaching the End of the Test 1.After students answer the last question on the test, the End Test button will appear in the upper-left corner of the screen.

74. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 74 Reaching the End of the Test 2.Upon selecting the End Test button, an “Attention” message will appear. –Students will select [Yes] to proceed with reviewing answers and submitting the test.

75. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 75 Reaching the End of the Test 3.Students may review answers before submitting a test.

76. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 76 Reaching the End of the Test 4.When a student is ready to submit the test, he or she will receive a confirmation screen.

77. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 77 Test Expiration Rules A student’s CAT remains active until the student completes and submits the test, the selected test administration window ends, or 45 calendar days after the student has begun the CAT. A student’s Performance Task remains active for 10 calendar days after the student has begun it. New: A student’s test expires at the end of the selected test administration window. New: An expired Performance Task may be extended an additional 10 days. New: Selected test administration window may be extended an additional 10 days.

78. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 78 Classroom Activity Administration Guidelines All students will be assigned a classroom activity. The classroom activity may be administered in a classroom or any other appropriate space. Designed to be given prior to administering the Performance Task. –For ELA, 1 to 3 days prior to administration of the Performance Task is recommended –For mathematics, administration on the day of the Performance Task is recommended No more than a 3-day lapse should occur between the classroom activity and the Performance Task administration.

79. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 79 Classroom Activity Administration Guidelines The classroom activity is designed to fit into a 30- minute window. –Time will vary according to complexity of topic and individual student needs. The site coordinator should download the assigned classroom activity and provide to test administrators at least 1–2 days prior. –Any LEAs that do not have a classroom activity assigned should administer the default classroom activity.

80. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 80 Classroom Activity Administration Guidelines Computers, projectors, and other technology are allowed but not required for the classroom activity. The classroom activity involves the participation of all students in an instructional task. The Performance Task is to be completed by individual students on the testing device. Students may take notes during the classroom activity, but the notes must be collected and securely destroyed. before proceeding to the Performance Task.

81. Measuring the Power of Learning.™ Test Security

82. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 82 Test Security There are three different types of test security incidents: 1.Impropriety 2.Irregularity 3.Breach

83. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 83 Test Impropriety Unusual circumstance that has a low impact on the testing individual or group of students Low risk of affecting student performance, test security, or test validity Correctable and containable at local level Must be reported to the LEA CAASPP coordinator or the test site coordinator –Coordinator must report the impropriety, using the STAIRS form within 24 hours of the incident May be reported in the appeals module should an appeal be required

84. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 84 Test Irregularity Unusual circumstance that impacts the testing individual or group of students May affect student performance, test security, or test validity Correctable and containable at local level New: LEAs are not required to report failure to administer the classroom activity Must be reported to the LEA CAASPP coordinator or the test site coordinator –Coordinator must report the irregularity, using the STAIRS form within 24 hours of the incident If needed, coordinator will be instructed to submit an appeal in the TOMS Appeals module for resolution

85. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 85 Test Breach Event that threatens test validity (e.g., release of secure materials) Example: Student or administrator takes a photograph and posts to social media External implications for the Consortium Must be reported to the LEA CAASPP coordinator or the test site coordinator, who must report the breach, using the STAIRS form within 24 hours of the incident

86. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 86 Test Security Incidents Type and Examples Type of Security IncidentExample Test ImproprietyStudents talking during testing Test IrregularityStudent cheating or providing answers to one another Test IrregularityStudent accessing or using electronic equipment (e.g., cell phone) Test BreachAdministrator or coordinator modifying student responses or record at any time Test BreachAdministrator allowing students to take home test questions, passages, prompts, or scratch paper

87. Measuring the Power of Learning.™ Assessment Target Reports

88. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 88 Assessment Target Reports Assessment Targets: –Describe the expectations of what will be assessed by the items and tasks within each claim. –Represent the prioritized content for summative assessment at each grade level. –Have been used to develop more detailed item and task descriptions through the item specification process. Assessment Target Reports: –Support data-driven program evaluation. –Contribute to the investigation of a group of students’ strengths and needs. –Constitute one of many sources of evidence that should be used in evaluating student performance.

89. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 89 Assessment Target Reports Assessment Target Reports are reported at the aggregate level by grade or roster but will not be reported for individual students. Assessment Target Reports include data from the 2014–15 test administration.

90. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 90 Assessment Target Reports Target scores are reported for groups of students. Caution should be used in interpreting results with fewer than 50 students. Only LEAs that complete online summative ELA and mathematics assessments will receive target scores. –Assessment Target Reports are not available for LEAs that administered paper-pencil Smarter Balanced ELA and mathematics assessments. Target scores are available for all four ELA claims (i.e., Reading, Writing, Listening, and Research/Inquiry). Target scores are available for one mathematics claim (i.e., Concepts and Procedures).

91. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 91 Assessment Target Reports Assessment Target Reports will be available through the Online Reporting System (ORS). Users that have access to ORS will have access to the Assessment Target Reports. –Level of access is based on the user role assigned to a particular user. Users will be able to download Assessment Target Reports.

92. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 92 Assessment Target Reports In preparation for the release of the 2015–16 Assessment Target Reports, the Assessment Target Reports for the 2014–15 administration will be available in February 2016. Additional resources that support the use of Assessment Target Reports to inform teaching and learning will be available in February 2016: –Video tutorial –Step-by-step instructions

93. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 93 Assessment Target Reports Pending Approval

94. Measuring the Power of Learning.™ Smarter Balanced Scoring and Reporting

95. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 95 Completion Rules Completion of the Smarter Balanced online assessments is dependent on the student completing both parts of the assessment in each content area: 1.CAT 2.Performance Task Important: Students that do not complete both parts will not receive an overall score.

96. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 96 If a student responds to fewer than 10 CAT questions and fewer than one Performance Task question, the student will be assigned the following for that content area: –Lowest Obtainable Scale Score (LOSS) –Lowest Achievement Level (Standard Not Met–Level 1) Students assigned the LOSS are counted in the number enrolled and in the number tested, but they are not included with the number of tests with valid scores. Scoring Considerations: Overall Score

97. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 97 Scoring Considerations: Claim Scores A student will receive a claim scale score if the student responds to the majority of questions that contribute to the claim.

98. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 98 Updates to Scoring and Reporting New: Scale scores on the claims will be included in the downloadable data files, beginning with the 2015–16 test administration. Student Score Reports will only include achievement levels for claims (i.e., Above Standard, Near Standard, Below Standard).

99. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 99 Avoiding Scoring Delays ETS may place a temporary hold on scoring a student’s results to investigate and/or clarify information provided; for example: –SSID has multiple students’ test results. –Student has more than one answer document or test results for the same test. –Student answer document was returned incomplete. –Student record was not found in TOMS. If a temporary hold is placed on a student score, it will delay the reporting of results in ORS, Student Score Reports, and data files.

100. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 100 Online Reporting System New: Addition of CAAs scores in the fall 2016 New: Expanded to include additional demographic fields (i.e., same fields that are included in CAASPP Web reporting site) for aggregate reporting New: Ability to create rosters at the school level for aggregate reports and comparisons among groups of students New: Availability of aggregate Assessment Target Reports for online summative ELA and mathematics assessments as scores are loaded into ORS

101. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 101 Preliminary scores and aggregate reporting: –The Online Reporting System (ORS) will include scores for online summative assessments for ELA and mathematics and paper-pencil scores for Science (CST, CMA, CAPA) and STS for RLA. –Online summative scores for a content area will be in ORS within 3 weeks of a student having completed the CAT and Performance Task for that content area. –Paper-pencil scores will be in ORS within 5 weeks of a student’s answer document released for scoring. Online Reporting System

102. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 102 Score Reporting Scores for reporting will be released once all accuracy checks are completed. Early testing LEAs likely will receive preliminary scores later than the timelines described in the previous slide.

103. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 103 2015–16 Student Score Reports A revised design of the Student Score Reports will be reviewed and submitted for approval by the State Board of Education in January. The proposed Student Score Report document is available on the January 2016 CDE State Board of Education as a Web document at http://www.cde.ca.gov/be/ag/ag/yr16/documents/j an16item04a1.pdf. http://www.cde.ca.gov/be/ag/ag/yr16/documents/j an16item04a1.pdf

104. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 104 Sample Student Score Reports

105. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 105 Student Score Report Updates The CAA and CAPA Student Score Reports will be provided separately for the 2015–16 administration and will be available in fall 2016. New: Option to select Spanish Student Score Report at the student level in TOMS : –If selected, the student’s report will be available in English and Spanish, except STS, which will be provided in Spanish only. –Both the initial and final versions will be created in both English and Spanish and will be available in TOMS to download and print locally. If parents/guardians have exempted their child from all 2015–16 CAASPP tests, no Student Score Report will be created.

106. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 106 Initial Student Score Reports New: Initial Student Score Reports will be provided in downloadable PDF files in TOMS 1 week after the student’s last score is reported in ORS. Initial Student Score Reports are created during the test administration window as the student completes the last assigned test.

107. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 107 Initial Student Score Reports Initial Student Score Reports will not be created for incomplete student records, such as: –Student has an open appeal. –Student who did not complete both parts (CAT + Performance Task) for a content area. –Student has an expired test. –Student records receive a special scoring code by ETS for reporting purposes (Not Tested, NEL-Student is exempt due to English learner status, SCL-Student completed a test and the grade level does not match the grade of enrollment). –Student score is temporarily held by ETS for investigation and/or clarification.

108. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 108 Final Student Score Reports Final Student Score Reports will be delivered to LEAs in printed format for distribution to parents/guardians. Student Score Reports must be delivered to parents/guardians within 20 days of receipt of the first shipment (California Code of Regulations, Title 5, Section 863). Electronic packaging list will be available in TOMS. Final Student Score Reports will be packed by school, grade, and alphabetical order. Each group will be separated by folders in the box.

109. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 109 Sample Reporting Timeline

110. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 110 Scoring Progress Dashboard At 80% of student scores completed for the LEA’s administration, the LEA CAASPP coordinator will receive a notification to carry out the following: –Complete testing for students with processed appeals. –Verify condition codes are and enter any remaining condition codes. –Set Spanish Student Score Report indicators. –Select parent/guardian address (if desired). At 90% of student scores completed, the final Student Score Reports will be printed, packaged, and delivered to LEAs. At the end of scoring, all remaining final Student Score Reports will be delivered in a separate shipment. TOMS will have a dashboard displaying the progress of scoring for your LEA’s administration

111. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 111 Public Web Reporting Summative ELA and mathematics Web site will be expanded to include: –Comparisons across entities—LEAs or schools –Multi-school year data provided for 2014–15 and 2015–16 aggregate scores –CAAs added to site and score data, to be made available in fall 2016

112. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 112 Data Explorer New analytical tool available fall 2016 Rollout to LEA CAASPP coordinators Sign on through TOMS for secure access Ability to run quick cross-tab aggregate reports – A cross-tab report shows the relationship between two or more data elements (e.g., report of ELA scale scores by gender and ethnicity). Ability to build custom reports or create graphs Comparisons across entities—schools, LEAs, counties, and state-level

113. Measuring the Power of Learning.™ Digital Library

114. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 114 Resources for Promoting Use of the Digital Library The following resources are available on the CDE Digital Library Web Page at http://www.cde.ca.gov/ta/tg/sa/diglib.asp.http://www.cde.ca.gov/ta/tg/sa/diglib.asp Videos –Introducing the Smarter Balanced Digital Library –Quality Criteria for the Digital Library –Exploring the Smarter Balanced Digital Library Smarter Balanced Digital Library Spotlight Webinars and Forums –Features Webinars presented by resource authors; followed by forum discussions facilitated by authors

115. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 115 Resources for Promoting Use of the Digital Library These resources are available on the CDE Digital Library Web Page at http://www.cde.ca.gov/ta/tg/sa/diglib.asp.http://www.cde.ca.gov/ta/tg/sa/diglib.asp Documents –The Formative Assessment Process (PDF) –Digital Library Fact Sheet (PDF) –Digital Library Overview and Sample Resources (PDF) –Digital Library Introduction for Teachers (PPT)  Includes script Another useful resource can be found on the CAASPP Portal Web site at http://www.caaspp.org/ http://www.caaspp.org/ –Smarter Balanced Digital Library and Interim Assessment Clinic Presentation (PDF)

116. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 116 Strategies to Encourage Use of the Digital Library Spend time working with site coordinators, district staff, and teachers to familiarize them with the Digital Library. Dedicate time during staff meetings and/or professional development time to explore the Digital Library. Dedicate time to review the resources provided on the CDE Digital Library Web Page and materials covered today. Implement formative assessment processes and practices for grade-level teams and school sites.

117. Measuring the Power of Learning.™ Interim Assessments

118. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 118 Overview of the Smarter Balanced Interim Assessments Two types of interim assessments: Interim Comprehensive Assessments (ICAs) –ELA, mathematics, and Performance Tasks for each content area –Look and feel like the summative assessments –Between 35 and 50 questions per computer-based fixed form Interim Assessment Blocks (IABs) –Shorter and more focused on specific content –Designed to allow flexibility with individual pacing plans –Between 5 and 20 questions per IAB

119. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 119 Benefits of Using the Interim Assessments Evaluate progress and plan adjustments to increase student learning. Experience content and questions reflective of the summative assessments. Excellent opportunity to try out accessibility supports with students and actual test questions. Build teacher comfort with the process of online scoring.

120. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 120 Using Interim Assessment Results Interim assessment results may help inform: Progress on the California State Standards (when combined with other information) Identification of specific areas of strength and weakness

121. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 121 Interim Assessment Viewing System

122. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 122 Interim Assessment Viewing System

123. Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 123 Interim Assessment Resources Available on the CDE CAASPP Interim Assessments Web page at http://www.cde.ca.gov/ta/tg/sa/sbacinterimassess.asp http://www.cde.ca.gov/ta/tg/sa/sbacinterimassess.asp –IAB blueprints –Number of questions in ICAs and IABs that require hand scoring –Estimated times for hand scoring questions Available on CAASPP Web page –Training Guides and Exemplars http://www.caaspp.org/ta-resources/interim.html http://www.caaspp.org/ta-resources/interim.html –Archived Webcasts http://www.caaspp.org/training/caaspphttp://www.caaspp.org/training/caaspp  Smarter Balanced Interim Assessments: Part I (January 2015)  Smarter Balanced Interim Assessments: Part II (January 2015) Interim Assessment Video Series Coming Soon! Interim Assessment User Guide Coming Soon!

124. Measuring the Power of Learning.™ Questions