1. Online HSAP Reporting System for HSA, HSA-Alt, and EOC Exams September 19, 2013 2:30 PM - 3:30 PM HST For audio, please call 1-800-741-8620 1

2. Accessing Today’s Webinar Training 2

3. 3

4. Today’s Agenda Presentation General Overview New Features for 2013-2014 Things to Remember Note: We are recording this webinar training and it will be posted online at www.alohahsap.org. 4 Q & A You can submit written questions anytime through the “Q & A” function on your toolbar at the bottom of your screen. We will collect these questions and answer them verbally during the Q & A section. You can also ask your questions via phone during the Q & A section after the presentation. The operator will announce when you can ask questions verbally.

5. Score Reports Subject Detail Page 5 Roster Page Student Detail Page Reporting Categories Detail Page (only for HSA & EOC) Trend Page Benchmarks Page (only for EOC)

6. Test Management Center 6 Summary Statistics Retrieve Student Results Plan and Manage Testing Status of Students Tested

7. Navigation is done with the Exploration Menu. The Exploration Menu is present wherever you see a magnifying glass. Three dimensions of data: – Who: Which entities do you want to access (e.g., schools, teachers, rosters, students)? – What: What level of the content area is being investigated (e.g., content area, reporting categories)? – When: Are you looking at the current test window or a historical trend? You can move up and down any one of these dimensions with the Exploration Menu. 7 Navigating the Online Reports

8. 8 Exploration Menu Who What When Click to move to a higher level of a dimension Click to drill down to details of a dimension

9. 9 Levels of the Three Dimensions State Complex Area ComplexSchoolTeacherRosterStudent Content Area Reporting Categories HCPS III Benchmarks or CCSS Testing Window Trend

10. User Roles and Report Access Users State Users Complex Area Superintendents Complex Staff Principals Test Coordinators Teachers Drill Down Access Teachers see their rosters and their students. Principals and test coordinators see the teachers, rosters, and students in the school. Complex staff see the complex, schools in that complex, and the teachers, rosters, and students in each school. Complex area superintendents see the complex area, complexes in that complex area, schools in each complex, and the teachers, rosters, and students in each school. 10

11. Online Reporting System shares its password with other secure sites that require login (TIDE, TA Site, TA Certification Course, etc.). Data presented are in real time for online tests; reports are updated as students test. Score reports are available after testing: – Student-level data (except for Expository Writing I EOC Exam that requires hand scoring of essays before students’ scores are posted) – Aggregate data (state, complex area, complex, school, teacher, roster) Online Reporting System allows users to view their current students' scores for previous school years. 11 Key Features

12. Go to the portal at www.alohahsap.org. www.alohahsap.org Click Teachers or Test Coordinators/ Administrators button. Click Online Reporting System icon to be directed to the System Login page. Enter your username and password. Click Log In. 12 Logging in to Online Reporting System

13. Home Page 13 Percentage of Students Proficient Across Grades and Content Areas 13 “Show Scores” category Select test and administration

14. Logging in as School User: Exploring 14 Click on the percentage proficient for a particular grade and content area to view more data.

15. Content Area Detail Page The title of each table describes the page in detail. 15 Note: “Percent Completed” column does not appear for HSA-Alt.

16. Content Area-Level Data All tables can be disaggregated by subgroups and accommodations such as: - Gender - Ethnicity - Language - Text-to-speech The table shows data for the user’s access level (in this case, AIR Training School). 16

17. Content Area-Level Data Higher levels of aggregations for comparison Subgroups: schools in a complex; teachers in a school; or rosters of a teacher The graphs show the distribution of students across performance levels. 17

18. Exploring the Data 18 Click the magnifying glass. Click View ROSTER button to go to the Roster page.

19. Roster Page 19 Click the magnifying glass. Click View STUDENT button to go to the Student Listing page.

20. Student Listing Page 20 Click the magnifying glass. Click View STUDENT button to view the selected student’s individual report.

21. Student Detail Page Graphical representation of the student’s performance along with performance level descriptors in family friendly language Performance for each reporting category Comparison of the student's previous opportunities for a content area assessment 21 Accommodations that the student was provided

22. Reporting Categories Click View Reporting Categories to go to the Reporting Categories Detail page. 22 Click the magnifying glass. Note: Reporting Category reports are NOT available for the HSA-Alt assessments because there are too few items administered within a reporting category to serve as a reliable indicator of student ability.

23. Reporting Category-Level Data Data are presented for each reporting category. The graphs show the distribution of students across performance levels. 23 Note: Reporting Category reports are NOT available for the HSA-Alt assessments because there are too few items administered within a reporting category to serve as a reliable indicator of student ability.

24. Benchmarks Click the magnifying glass. Click View Benchmarks button to go to the Benchmarks Report page. 24 Note: Benchmark reports are only available for the Algebra I, Algebra II, Biology I, and U.S. History EOC Exams. The word "Benchmark" is used in the title of this report for the HCPS III based and CCSS based EOC exams in the Online Reporting System.

25. Benchmark-Level Data Relative performance across benchmarks is denoted by +, –, or =. 25 Note: Benchmark reports are only available for the Algebra I, Algebra II, Biology I, and U.S. History EOC Exams.

26. Trend Click View Trend to go to the Trend page and view the selected student’s performance over time. 26 Click the magnifying glass. Note: Trend reports will be available for the HSA-Alt Reading and Mathematics Assessments in Spring 2014. These reports will not be provided for the HSA-Alt Science Assessment because scale scores are not vertically linked across grades.

27. Trend Page 27 Note: Trend reports will be available for the HSA-Alt Reading and Mathematics Assessments in Spring 2014. These reports will not be provided for the HSA-Alt Science Assessment because scale scores are not vertically linked across grades.

28. Dashboard shows percentage tested and percent proficient. Authorized users can create a calendar of school determined testing windows for different opportunities to organize test administrations. Choose What to include Click Generate Report 28 Test Management Center: Summary Statistics

29. This is an optional feature for school users to create, record, and manage planned testing windows for different opportunities in their school. These testing windows are independent of the official Hawai`i Department of Education testing windows. 29 My Testing Windows Click Add to add a testing window. This pop-up window will appear.

30. Data file has score report and activity/progress report data across content areas. File is available for 30 days. User is alerted by e-mail when the file is ready. Choose What and Who to include in data file Click Download Roster Choose a file format Download completed data file 30 Test Management Center: Retrieve Student Results

31. Choose What and Who to include in report, then filter with specific information about student’s activity and progress. Display onscreen or export to Excel 31 Test Management Center: Plan and Manage Testing

32. School, complex, and complex area users can create a file showing the number of students who have started and completed each assessment or exam by school, grade, content area, and opportunity. 32 Test Management Center: Status of Students Tested

33. Search by SSIDs, separated by commas (,). Search by student’s first name or last name (not both at once). Search by wildcard (letters or numbers). Search is conducted by school year, so you can search students you used to have. 33 Search Students

34. Student Search Results Click + to expand the information for a student. All available reports will display. Click on a report to view the individual student report. Report will return all of your students that match your search criteria. 34

35. Create custom roster for any of your students. Name the roster and assign it to teacher. Edit or delete the roster at any time. The roster will appear in the Online Reporting System. 35 Manage Rosters

36. 36 Name and assign the roster Select the desired grade(s) Select from available students and move students in/out of roster Save or Delete

37. 37 New Features for 2013–2014 Test condition events filter Batch printing functionality for individual student reports: – PDF format – Option to print all scores, highest score, or most recent score for tests that include multiple attempts (i.e., HSA)

38. Similar to the breakdown by demographic subgroup filter, users will now be able to disaggregate the score report data by a specific test accommodation (e.g., text-to-speech). 38 Test Condition Events Filter

39. Users will now be able to batch print individual student reports in PDF and not in HTML. 39 Batch Printing Functionality As a result of this change, users will need to go to their inbox to download and batch print the PDF files.

40. For HSA, users will now have the option to print all scores, the highest score, or most recent score. 40 Batch Printing Functionality

41. Online Reporting System is designed to help educators answer questions regarding the assessment data to improve teaching and learning. The magnifying glass icon indicates what data can be further explored. All tables can be printed and exported. Help (User Guide) button is available for every page. Manage Rosters tool enables users to report on specific groups of students. 41 Things to Remember

42. Visit www.alohahsap.org.www.alohahsap.org Call or e-mail the American Institutes for Research HSAP Help Desk. – Hours: Monday- Friday except holidays, 7:30 a.m. to 4:00 p.m. HST – Phone: 1-866-648-3712 – E-mail: HSAPHelpDesk@air.orgHSAPHelpDesk@air.org 42 Need Help or More Information?

43. Thank you! And now on to Q & A………. 43 For more information, visit: the HSAP portal at www.alohahsap.orgwww.alohahsap.org For assistance, please call or e-mail the HSAP Help Desk: Hours: Monday- Friday except holidays, 7:30 a.m. to 4:00 p.m. HST Phone: 1-866-648-3712 E-mail: HSAPHelpDesk@air.orgHSAPHelpDesk@air.org