1. AIR Ways Training Module Posted October 10, 2017
Welcome to the online training module for the AIR Ways reporting system. This training module discusses the information and features of the system. For more in depth information you can review the AIR Ways User Guide on the WCAP portal.
Posted October 10, 2017
This presentation contains a script in the notes section. If you are accessing this information with a screen reader, be sure you are reading the notes section as well as the text contained in the slides.
Copyright © 2016 American Institutes for Research. All rights reserved.

2. Objectives
After viewing this presentation, you should understand how to:
Navigate AIR Ways
View student test results and performance on items
Search for specific students
Download and print report information
Change display settings
Customize the appearance of report tables
After viewing this presentation, you should understand how to:
Navigate AIR Ways
View student test results and performance on items
Search for specific students
Download and print report information
Change display settings
Customize the appearance of report tables

3. What is AIR Ways
AIR Ways is a reporting system that provides teachers with detailed information on student performance on Interim Assessments.
AIR Ways is a reporting system that provides teachers (in the role of Test Administrators) with detailed information about their students performance on Smarter Balanced Interim Assessments. The reports show student responses to items, and information on which items students in a class performed the best or worst.
School and District level users can also use AIR Ways to see the data at the school and district level.
AIR Ways Reporting provides insight into how students performed on specific items of interim assessments. Teachers can use the system to view students’ actual work, presenting a clear picture of the topics that students have mastered and where they need to improve.

4. How Data Gets to AIR Ways
Use AVA, the teacher hand-scoring materials in TIDE, and the interim blueprints to decide which interim to administer.
Administer the interim to students using the TA site and the secure browser.
Use the THSS to score constructed response items using the materials located in TIDE.
View high-level reports in ORS. View more detailed, item level reports in AIR Ways.
AIR Ways is at the end of a set of assessment events. Educators should use the Assessment Viewing Application (AVA), the teacher hand-scoring materials located in TIDE, and the interim blueprints posted in the General Information folder on the WCAP Portal to help them determine which Interim assessment to give to students. Then the Test Administration interface and the Washington Secure browser are used to administer an Interim Comprehensive Assessment (ICA) or an Interim Assessment Block (IAB) to students. The student responses to any constructed response items are then scored by educators at the local level via the Teacher Hand Scoring System. After hand-scoring is completed, data will be available in both the Online Reporting System (ORS) and in the AIR Ways reporting system. AIR Ways only displays interim data for the current school year. To view high-level summaries of interim results from previous years, use the Online Reporting System (ORS). If no hand-scoring is needed, which is true for many of the IABs, scores will be available in ORS and AIR Ways soon after the completion of testing.
Each of these systems has their own User Guide and Training Module available on the WCAP Portal. Please refer to those materials for questions about those steps of the process.

5. Assessments and Data in AIR Ways
District Assessment Reports
School Assessment Reports
The Assessment Reports in AIR Ways provide detailed information about how the students associated with a user or institution performed on an individual assessment. Assessment Reports display a column of student performance data for the assessment as a whole, for each claim (reporting category), and on individual items in the interim assessment. The reports are available for each assessment at various levels within the district:
The data available in AIR Ways depends on the user’s level of access and the report you are viewing:
The Teacher Reports include data for all the assessments associated with a given teacher. This includes the following:
All data for any student who participated in a test session proctored by that teacher during the current school year (including data for assessments completed in other teachers’ test sessions).
All data for any student who are members of that teacher’s rosters as of Fall of the current school year (including data for assessments they completed in other teachers’ test sessions).
School Reports include data for all current-school-year assessments associated with teachers who belong to a given school.
District Reports include data for all current-school-year assessments associated with the schools that belong to that district.
All of these reports (excluding the District Assessment Report) also provide information about how students responded to the individual items in each Interim Comprehensive Assessment or Interim Assessment Block and allow you to view those items. Authorized users can navigate from a higher-level Assessment Report to a lower level Assessment Report for institutions and users who are members of their institution. For example, district-level users can access the School Assessment Report for each school listed in their District Assessment Report.
Teacher Assessment Reports

6. Teacher Dashboard Specific Assessments Specific Students
The Teacher Dashboard is the landing page for Test Administrators in AIR Ways. From this page, you can see how your students performed on a specific assessment or you can see how a specific student has performed across assessments.
When you log in you’ll see two tables. The top table is the My Assessments table. It displays all assessments your students have taken as well as the average score and performance distribution of all assessments for all your students.
The bottom table is the My Students table, it displays a list of your students (rostered and proctored) who’ve taken any test as well as when they last took a test.
Specific Students

7. My Assessments Table
The My Assessments table provides information about how your students did, organized by assessment. The table shows at a glance information on all of the assessments your students took.
Assessment name shows the name of the assessment.
The Test Reason column will show the test reason selected by the proctor in the Test Administration Interface when the test was given. If no reason was selected, this column will show Unassigned.
The Student Count column shows you how many of your students took the specific test.
The Average Score and Performance Distribution columns will show how your students did on the specific interim assessment. ICAs and IABs will have slightly different information in these columns. ICAs will have a numerical score on the same scale as the summative assessment, and IABs will have an "n/a" in the average score column. ICAs will have 4 performance levels, and IABs will have 3 categories in the Performance Distribution column.
The Last Date Taken column lists the last time one of your students took the assessment.
Each column can be sorted using the up and down arrows at the top of the column.
If you want to see how each of your students did on a specific assessment, click on the assessment name, or the magnifying glass to the left.
Click on the assessment name to view students who took that assessment.

8. My Students’ Performance on Assessment
Click on the item number to see a “blank” version of the item. Click on the points earned to view the item and student’s response
Once you’ve selected the assessment you want to see, it will take you to a page of all of your students who took this assessment. This report can be used to compare how individual students have performed compared to the rest of the students as well as to show you how your class did as a whole.
There is a row which shows performance data for all of the students shown (1), as well as a row for each student who took the test (2).
The ‘Everyone’ row has the average score and performance level for students listed. In the further columns it lists the points possible for each item. If you want to see the item you can click on the item number in the top row (3). This will show the blank item as the student saw it.
If you want to see a specific student’s response to an item, click on the point value in the student’s row (4). A pop-up will appear showing the item and student's response. For some items, this pop-up also provides information about the item's difficulty, alignment, and scoring.
Score and performance information for the class as a whole Item numbers
Individual student’s results  Student points earned

9. Item Response Information
The item response page gives you specific information about how your student answered the question. This view can be used to analyze the student’s understanding of individual item topics. If the student didn’t earn full points, looking at the item view allows you to see where your student may have made the error.
At the top of the page are navigation arrows. At the top left and top right, the arrows allow you to move between different items for the same student, seeing how the student responded to different items. In the middle, the arrow allows you to move between different students for the same item, seeing how different students responded to the same item.
In the top row (1) you will see the student’s name, item number, and test.
Under details (2) you can find out the specific content alignment of the item.
The item section (3) shows the item as the student saw it, as well as the student’s responses.
The rubric section (4) may show scoring information for the item. If the item is machine scored, it will also show if the child answered correctly or incorrectly.

10. Student Portfolio
Compare Student’s Score to Average Score of My Students
Compare Student’s Performance to Performance Distribution of My Students
Click on an assessment, and then an item, to view a student’s item response.
To return to the Dashboard, click on the Dashboard link at the top left of the page.
Then, you can select a specific student on the My Students report. This will take you to the student portfolio page.
This report provides score and performance data for all assessments a student has completed. The table allows for the comparison of the Student’s Score to the Average Score of My Students (1), and the Student’s Performance Level to the distribution of performance levels across a teacher’s students (2).
To access the student’s item response on a selected assessment using this report, click on an assessment, and then an item, as in slide 6.

11. School (and District) Reports
Assessment label: Name of the assessment
Student count: Number of students who took the specific assessment in your district/school
Student performance: Performance average for all students in your district or school who took the specific assessment.
The Dashboard landing page is very similar for both school and district users. In both cases the dashboard will show a summary of the assessments students in your jurisdiction have taken.
Unlike the Teacher Dashboard only one table will appear, the Average Score and Performance Distribution by Assessment for the school or district.
For a district user, clicking on an assessment will take you to the school level, as the school user sees when they log in. 

12. School (and District) Reports, Cont’d
When looking at the Performance Distribution column, remember that the ICAs and IABs will have different information.
As shown on the left, the IABs will have 3 categories: Below Standard, At/Near Standard, and Above Standard, which are like the claim scores in the Summative assessments. As shown on the right, ICAs will have 4 performance levels, which are the same as the performance levels on the Summative assessment. Click the “i" icon next to the graph for a key to explain the various colors in the column.

13. School Performance on Assessment
This tab shows performance by each class or roster on the selected assessment
The School Performance on the Test page has two tabs. Performance by class, showing how each class or roster performed and performance by student, showing a list of every student in the school who took the test and their performance.
Click on this tab to see a list of students in the school who took the specified assessment.

14. Performance by Class
Class: Name of the class and roster and the teacher associated with that class/roster
Student count and percent complete: Number of students in the roster who took the specific assessment and percent of students in the roster who have taken that assessment
Student performance: Performance average for all students in the roster who took the specific assessment
Item Scores: These regions group items by how the students in the roster preformed on the items. This shows the 5 best and 5 worse as well as the total items. Clicking on the item score will show the item.
To see how each class/roster in your school performed, choose the performance by class tab. In this tab you can compare class/roster performance on the specific assessment with other classes or rosters as well as the school overall. This view will allow you to identify rosters or classes that may need more attention, and allow you to modify instruction for them. This view also shows the items that the students in the rosters shown did the best and worst on. These areas can be opened or closed to show only the best, only the worse, or all items. This information can be seen by Teachers, School levels users, and District levels users.

15. Performance by Student
Student Name and Student ID: Name and ID number of the student
Student performance: Performance average for all students shown and for each student shown
Item Scores: These regions group items by how the student performed. This shows the 5 best and 5 worse as well as the total items. Clicking on the item score will show the item.
To see how each student in your school performed, choose the performance by student tab. In this tab you can compare students’ performance on the specific assessment with the other students in the school, or click on a specific student to bring up the performance by student page.

16. Header Bar and other features.
 Navigation links: Current page and links to navigate to previous pages
 Inbox: location of saved reports
 My Settings: where to manage rosters and create or manage assessment or Class preferences
 Print button: Print the current page or data associated with the page
y SSID search: Search for an individual student by SSID
AIR Ways navigation is based on the text at the top. (1)The bolded section shows the current page. The links can be used to navigate to previous pages.
AIR Ways has other features to assist teachers and school and district users. You may print or download the page you are viewing by clicking the printer in the upper right. (4). If you want to be able to manipulate the data you can save the file as a csv through the print link rather than as a pdf. You will also be able to choose if you want to print or download a summary of the data or the data including student scores.
Reports that you have printed or downloaded are saved in the Inbox indicated in (2) above in the screenshot.
You can also choose which test you want to see in your reports in the My Settings feature (3). Please see the next slide for more details.
If you want to go directly to a student’s portfolio page, listing all of the tests taken by that student you can search using the student’s SSID indicated in (5) above in the screenshot.
If you would like more information on anything discussed in this presentation please see the AIR Ways Reporting User Guide located on the WCAP Portal.

17. My Settings Feature
As mentioned in the previous slide, there is a feature called My Settings. As a teacher, if you click on the My Settings feature and select ‘Select Tests to Display’, you can pick if you want to show all tests your students have taken or only specific ones. As a School or District Coordinator you can choose to either see all assessments and students or to use your teachers’ preferences. Teachers may also manage their rosters by selecting the ‘View/Edit Rosters’ option from My Settings.

18. Print Feature
The Print Feature allows users to download and print the various reports in AIR Ways. Select the print button in the top right corner, and print options will appear. You can also save a PDF or CSV file of the data. A CSV file can be opened with Excel so that you can work with the information.

19. Using the Inbox
Downloaded reports as PDF or CSV files will appear in your Inbox, which is located in the banner. Click the Download button next to the report in order to download it.

20. My Settings
Users wishing to manage test reasons, change display settings, manage rosters, or change their user role can perform these tasks using the My Settings feature. This options in this list will vary, depending on your user role. In the next section of the training module, we will discuss these features in detail.

21. Manage Test Reasons: Search Test Sessions
If you wish to classify one or more test opportunities using test reasons, you can assign test reasons after the fact using the Manage Test Reasons feature.
To assign a test reason to a set of test opportunities, select Manage Test Reasons from the My Settings feature. In the popup window that appears, search for test opportunities by session ID or by an existing test reason and date. Click Search to display test opportunities.

22. Manage Test Reasons: Select Test Opportunities
Your results will appear in the bottom of the window. Test opportunities are organized hierarchically. Click the plus sign next to a session ID to see all the tests that were in that session ID. Click the plus sign next to a test name to see all the students who took that test during the session.
Select one or more checkboxes for test opportunities. You can select students individually or select all students who took a test or all students in a test session. When finished, scroll to the bottom of the popup window and click Assign Test Reasons to confirm your selections.

23. Manage Test Reasons: Assign Opportunities
Finally, you will be asked to select a test reason to assign to the selected opportunities. Choose a test reason from the drop-down list, and then click Confirm to assign the test reason.

24. Manage Rosters: Add Roster
Rosters are groups of students associated with a teacher in a particular school. Some reports in AIR Ways provide performance data for the students within a roster or for the roster as a whole. A roster created or modified in any AIR system that allows roster creation will be carried over to other systems that access rosters.
You can create new rosters from students associated with your school or district by selecting Add Rosters from the My Settings drop-down list. The Roster Manage page will appear as a popup window.
To add a new roster, select the district and school to which the roster belongs. Enter a roster name and select the name of the teacher who should be associated with the roster.
In the Test Settings and Tools panel and Additional Filters panel, refine the list of available students by selecting additional criteria from the drop-down lists and checkboxes. Then click Search Students.

25. Manage Rosters: Add Roster, continued
In the Add/Remove Students to the Roster section, the students in the left column are available to be added to the roster, and students in the right column are currently in the roster.
To add a single student to the roster, click the green plus sign next to a student in the left column. You can add multiple students to the roster by marking checkboxes next to the students you want to add, and then clicking Add Selected. Add all available students to the roster by clicking Add All.
To remove a single student from the roster, click the orange X next to a student in the right column. You can remove multiple students from the roster by marking checkboxes next to the students you want to remove, and then clicking Remove Selected. Remove all students from the roster by clicking Remove All.
When you are finished adding students, click Save to save the roster.

26. Manage Rosters: View/Edit/Export Rosters
The View/Edit/Export Rosters page includes a form for setting selection criteria to retrieve rosters. In this example, the district and school criteria are required. Click Search to display a list of rosters matching your criteria.
Print, export, or delete rosters from TIDE by selecting the desired rosters and clicking the Print, Export, or Delete button above the search results.
Click the pencil icon next to a roster to view or edit its details. The Edit Roster form will appear. This form is similar to the form used to add rosters, and you may edit the roster name, teacher name, and students in the roster in the same way that you would for a new roster.

27. Manage Rosters: Upload Rosters
A second way to add new rosters is to use the Upload Rosters page to compose an upload file in Excel or CSV format and then upload that file.
This task is performed by following the same steps used to upload new users and students: download a template file, enter information into the template, save, and click the Browse button to locate the file and upload it in to AIR Ways.

28. American Institutes for Research
Thank You!
Further Information
Washington Help Desk
American Institutes for Research
Tel
For questions regarding state policy decisions and protocol, please contact OSPI at
Thank you for taking the time to view this training module. For additional information, refer to your AIR Ways User Guide located on the WCAP Portal or contact the Washington Help Desk.

29. Revision Log
Updates to the Module after October 10, 2017 are noted below.
Section
Slide
Description of Change
Revision Date
If updates are needed throughout the school year, they will be outlined on this revision log and communicated in the WAW newsletter.