1. 2015-2016 SAGE Spring Summative Training Assessment and Accountability Utah State Office of Education

2. Content and Language Objectives Content Objective Participants will be prepared for the upcoming SAGE Spring Summative testing by having a hands-on experience with training tests, TIDE, and ORS. Language Objective Participants will become familiar with the terminology that applies to testing and work with their teachers to have students take the training tests. They will practice producing reports in TIDE and ORS.

3. What does it mean to be adaptive?

4. What is an adaptive test?

5. Standards-Based Adaptive Testing: Our Algorithm Every student is tested on the full range and depth of content, but at different levels of difficulty o Difficulty is determined by actual student performance Every student has the chance to demonstrate the same range of cognitive skills Utilizes grade level content Science Example: 4 th weather, 5 th chemical reactions, 6 th solar system A 5 th grade student will not receive questions about the solar system– but full ability range on chemical reactions Item difficulty, not cognitive complexity, adjusts to student performance

6. Background: The general idea behind adaptive testing All students will answer approximately 50% of the items correctly.

7. Questions?

8. Utah eTranscript and Record Exchange (UTREx)

9. The Flow of Data SIS (LEAs) UTREx (State) SAGE Systems (AIR) TIDE TDS SAGE Formative ORS

10. Student Data Exchanges - SAGE Student is entered into local student information system (SIS) SIS data is submitted to UTREx daily Valid data is sent to TIDE nightly Student data appears in TIDE the next day TIDE data drives SAGE Formative and Summative Rostering SAGE Interim and Summative Test Assignment

11. Test Eligibility Criteria: Enrollment ALL test eligibility for Interim and Summative is driven by course enrollment. Teaching and Learning/Special Ed oversee course codes. Student must complete assessment while enrolled in the course. Course codes: http://schools.utah.gov/assessment/Directors/Resources/CoreCodes.aspx 55

12. Which course does a student take? Students should be enrolled in courses appropriate for their grade-level: Ask Teaching and Learning or Special Ed Students cannot “test down” – students should receive on-grade-level instruction (and assessment) Example: 5 th grade students should not be enrolled in 4 th grade courses Students can accelerate, take tests as they finish courses

13. Test Eligibility Criteria: Flags Mark in SIS system UAA and DLM – IsOnePercent field WIDA Access – LEPproficiency field

14. Test Eligibility Criteria: Flags Students who are not required to take SAGE will be assigned to LEA 00. They may still test and receive data for instructional purposes, but will not be tied back to the school for accountability. Flagged as Foreign Exchange student Flagged as EL student who entered US After April 15 th, 2016 (no SAGE required) Flagged as EL student who entered US Before April 15 th, 2016 (no SAGE ELA required) Note: LEAs do not enroll students in LEA 00, USOE will do this. It will create a “pseudo-dual-enrollment”

15. Common Problems Student does not pass UTREx validation Missing SSID Improper codes Missing required information Invalid dates Courses are submitted to UTREx without teacher ID Student marked as exited from courses Data not submitted to UTREx or fails UTREx submission

16. If a Student Doesn’t Show Up… Check your SIS and make sure information is correct Check validation reports in UTREx once data is submitted Changes to SIS data should appear in TIDE within 4 days

17. UTREx Extracts: Other Assessments WIDA ACT DLM Utah Compose SAGE Formative (UTIPS – In Development)

18. 1.SAGE Portal Practice Tests 2.TIDE: Test Information Distribution Engine TIDE – Student Information TIDE – Manage Rosters TIDE – Special Codes 3.ORS – Plan and Manage Testing Summary Statistics Retrieve Student Results Plan and Manage Testing Test Completion Rates Test Status Code Report 4.ORS – Score Reports Demonstrations

19. SAGE Portal: Training Tests Overview Demonstration Hands-on Experience

20. Training Test vs Live Test LIVE Tests Use Secure Browser Select specific tests Shows LIVE in the test session ID Only Students! TRAINING Tests Can use Secure Browser or internet Students should use the Secure Browser Students enter SSID and first name Public should use internet Can enter as GUEST Test Session as GUEST Shows TRAIN in the test session ID

21. Student View of Testing When the secure browser is launched, it opens to this page. Students can access the Training Tests through this page as well.

22. Take a Training Test and Administer a Training Test These instruction are written for Chrome. In this workshop, you will practice using a (4 th ) grade SAGE test. 1. Go to Sageportal.org and Log In. 2. Select “Training Sites”, then “TA Training Site”. Guest or Log In Option Test Administrator

23. Take a Training Test and Administer a Training Test 3. Left click on the + sign beside Math, select Math Grades 3-4, and then “Start Training Session”. This opens a training session. Note the Training Session ID. Students will use this ID to log in to their assigned test.

24. Take a Training Test and Administer a Training Test 4. Open another window in Chrome. Go to Sageportal.org and Log In. Then select “Training Sites”, then “Training Tests”. In this activity, you will move between both windows in Chrome. In one window, you will be a student and in the other you will be the test administrator.

25. Take a Training Test and Administer a Training Test 5. Left click in the “Guest Session” box to unselect it. Type the session ID in the Guest Session, then click “Sign In”. In the “Is this you? menu, select “Student Grade Level 4” and then select “Yes”.

26. Take a Training Test and Administer a Training Test 6. Select “Start Math Grades 3-4”. The awaiting approval menu appears.

27. Take a Training Test and Administer a Training Test 7. Switch to the “TA Interface”. Left click “Approvals” and then “Approve ALL Students”. Confirm that you approve all students. In a live test, you may approve students or not approve students.

28. Take a Training Test and Administer a Training Test 8. Switch back to the “Student Test” tab. Students may select “Overview of the Test Site”, “Test Rules”, or “About Text-to-Speech”. Left click “Begin the Test” when you are ready. Text-to-Speech does not work in a training test.

29. Take a Training Test and Administer a Training Test 9. From the Global Menu” answer a question, then click next. Answer all questions so that you will learn how to use the test tools.

30. Take a Training Test and Administer a Training Test 10. When you have completed all questions, a screen pops up to say “you have answered all the questions in this test”. Select “OK”. Left click “End Test” and click “Yes” to continue to the next page.

31. 11. Click “Submit Test” yes if you want to end the test and you do not want to review your answers. Then click “Yes” if you want to submit your test. Take a Training Test and Administer a Training Test

32. 12. In a live test, the student will get immediate results in Math and Science. In ELA, students get results after both the reading and writing sessions are completed. Select “Log Out”. Take a Training Test and Administer a Training Test

33. 13. Change to the TA Interface tab. As the Test Administrator, you will monitor the test using this menu. At this time, it shows that your only student taking the test has completed the test. Left click “Stop” to end the test. Then select “OK” to end the test, Take a Training Test and Administer a Training Test

34. TIDE: Test Information Distribution Engine DataManagement System Demonstration Hands-on Experience

35. Accessing TIDE Go to the portal at http://sageportal.org/ http:/ sageportal.org/ Select the appropriate role: [Teachers], [Test Administrators] or [Assessment Directors]. Click the [TIDE] icon.

36. TIDE: Home View Student Information including Assigned Tests, Test Settings, & Accommodations View or mark Non- Participation and other Special Codes View Rosters, Create and Print Test Tickets

37. TIDE: Student Information Three things can be changed in “Student Information”: Interim Writing Prompts, Test Settings, and Specific Accommodations. Export to Excel View a Student Search by student or school.

38. TIDE: Student Information Three things can be changed in “Student Information”: Interim Writing Prompts, Test Settings, and Specific Accommodations. Any changes in “Test Settings” or “Accommodations” must be made before the student takes their SAGE test.

39. Print Test Tickets TIDE: Manage Rosters

40. Print Test Tickets

41. Special Codes Required for Spring Summative

42. TIDE: Special Code Assignments Special codes must be entered for all students who: Did not participate in the SAGE Summative test assigned. Received accommodations their SAGE test(s). To view or edit special codes, enter the student identifier information and select “Search”.

43. TIDE: Special Code Assignments Select the appropriate “Special Code ” for the specified SAGE Test from the drop-down menu. “Save Changes ”.

44. SAGE ORS Participation Reports Spring 2016 Overview Demonstration Hands-on Experience

45. Utah State Office of Education SAGE Online Reporting System (ORS) SAGE ORS http:/ sageportal.org

46. ORS Design The Online Reporting System (ORS) is designed to provide Utah educators with the assessment data and tools needed to understand the performance of their students and schools. The purpose of ORS is to provide ALL teachers immediate access to student results and class/school aggregates to identify student performance and support instructional and program goals.

47. Utah State Office of Education About the Data 225 SAGE Data Overview

48. Utah State Office of Education SAGE Data Overview: SCALE SCORES: ELA/Literacy 232

49. Utah State Office of Education SAGE Data Overview: SCALE SCORES: Mathematics 233

50. Utah State Office of Education SAGE Data Overview: SCALE SCORES: Science 234

51. SAGE Results: Which Group of Students Should I Choose? Scores for students who were mine at the end of the selected administration Scores for my current students Scores for students who were mine when they tested during the selected administration Allows you to see score data for your students as of June 15 th each year. Shows results for your current students, regardless of where they took the assessment. Used in the Fall by ALL Teachers Allows you to see score data for those students who were associated with you when they took the assessment. Used in the Spring to “see how we did”

52. Logging into the System Go to the portal at http://sageportal.org/ Click Teachers or Test Coordinators/ Administrators button. Click Online Reporting System icon to be directed to the System Login page. Enter your username and password. Click Log In.

53. SAGE ORS Select the “Plan and Manage Testing” bar to access SAGE testing Participation Reports. Select the “Score Reports” bar to access SAGE Score Reports.

54. Using ORS Participation Reports Actively Monitor Testing Through All Testing Windows Plan and Manage Testing Reports Details about individual student test participation Test Completion Rates Report Available daily by school and test (who has tested?) Test Status Code Report Monitor student participation: At the end of testing, who has answered less than 6 questions (needs special code)?

55. ORS: Plan and Manage Testing

56. The Plan and Manage Testing feature allow users to generate customized participation reports showing their students’ testing activity. You can determine which students have completed SAGE testing and which students have yet to begin or complete SAGE testing. 1.Choose the test, administration, test name, enrolled grade and test settings. 2.Select the school and teacher. 3.Select the Get Specific information that best matches your needs. 4.Select Generate Report to view the report on screen or select Export Report to open the report in Excel.

57. Test Management Center: Plan and Manage Testing

58. You can create an Excel file showing the number of students who have completed each SAGE test during the current administration. ORS: Test Completion Rates 1.Select the school. 2.Choose All or a specific SAGE test. 3.Click on the Export Report button.

59. ORS: Test Completion Rates A sample Test Completion Rates report is shown below. Date the report was generated SAGE Test Names LEA NAME and LEA ID School NAME and School ID Opportunity and Total Students Total Students Started and Total Students Completed Percentage Started and Percentage Completed

60. ORS: Test Status Code Report 1.Select a specific SAGE Test. 2.Choose the Administration. 3.Select Generate Report or Export Report.

61. ORS: Summary Statistics 1.Select the test, administration, and test name. 2.Click the Generate Report button. Summary Statistics allows you to view the students who have tested for a selected test by administration year and test name (subject and grade).

62. ORS: Summary Statistics Sample Summary Statistics Report

63. 1.Select the test, administration, tested grade, format, and filter information. 2.Provide the school, teacher, and class information to be requested. 3.Click on the Download Roster. 4.A message will appear indicating that the download has been queued. 5.When the report is ready, it will be appear in the Inbox. 6.The report is downloaded by clicking the Download link for the data file. ORS: Retrieve Student Results You can download student data by school, teacher, or class. The data reported includes students’ scale scores, and proficiency levels.

64. ORS: Retrieve Student Results Sample Excel file showing some of the data downloaded.