1. Online Reporting System Florida Standards Assessments (ELA/Mathematics, EOC)
This presentation will help you understand the key features and tools of Online Reporting System; the types of data you can access; and how this can be used in the district and school. To accomplish this, we will give an overview of some key components of the system and then provide a guided walk-through of the system itself.
Please note that the screenshots displayed in this presentation are mockups. They do not reflect the final look and feel of ORS, which may be slightly different based on the final development work.

2. What is the Online Reporting System?
Online Reporting System (ORS) is the gateway to viewing student results.
ORS also includes a tool to view participation data for computer-based tests.
Online Reporting System, also known as ORS, is the gateway to viewing student results from computer-based and paper-based testing. ORS is a system that enables educators and administrators to view student results and performance data for each test administration.
ORS also includes a tool to view participation data for computer-based tests. The Reports & Files section of ORS allows users to generate participation reports to determine which students have completed computer-based testing or need to complete computer-based testing.

3. Objectives of This Presentation
Understanding the organization of ORS
Learning to navigate the system and access data
Using Reports & Files and Interactive Reports and features
Accessing help and support
We will first provide a brief introduction to the system and then walk you through each of the system’s features. After this presentation, you should be able to navigate ORS and access various types of reports, use Interactive Reports and Reports & Files features, and know how to access help if you have questions or need support.

4. Online Reporting System Florida Standards Assessments
Understanding The Organization Of ORS

5. User Roles and Report Access
All ORS users must be assigned a user role in TIDE.
Each user has drill-down access when viewing score results.
School Administrators see the students in his or her school.
District Assessment Coordinators see the district, schools in that district, and the students in each school in that district.
ORS provides access to testing information based on user roles. There are two basic levels of user roles: district level and school level. Each user is granted drill-down access based on his or her assigned user role. This means that schools will be able to see data for the students in their school while districts will be able to see data for each school and students in the district.

6. User Roles and Access in ORS
DTC
CBT SA TA
Access Interpretive Reports
Subject Detail 
Student Listing
Individual Student Report
Access Reports and Files 
Participation Report
Test Completion Rates
Retrieve Student Results
Retrieve Aggregate Results
Search Students

7. Reports & Files Reports & Files Participation Report
Test Completion Rates
The second major feature is called Reports & Files. The Reports & Files feature allows users to generate customized participation reports to determine which students have completed or need to complete computer-based testing, view participation summary statistics (count and percentages) of students who tested, and download data files and static reports.
Retrieve Student Results
Retrieve Aggregate Results

8. Interactive Reports Interactive Reports Subject Detail Page
Reporting Category Page
ORS contains two major features. The first major feature is called Interactive Reports. Interactive Reports feature provides score data for each of the FSA assessments. Users can compare score data between individual students and the school, district, or overall state average scores.
Student Listing Page
(School Report of Students)
Individual Student Report Page

9. Online Reporting System Florida Standards Assessments
Learning To Navigate The System
And Access Data

10. Key Features
ORS shares its password with other secure sites that require a login (TIDE, Test Administrator Interface, etc.).
Score reports will include:
Student-level data
Aggregate data (state, district, school)
ORS allows users to access data files (e.g., DSR, SAR/DAR files) and generate static aggregate reports (e.g., State Report of Districts, District Report of Schools).
This powerpoint will go through the steps needed to acquire both the data files and the static reports.

11. Navigating Online Reports
Users can navigate throughout Interactive Reports on the ORS by using the Navigation Tool.
The Navigation Tool is present wherever you see a magnifying glass.
Three dimensions of data:
Who: Which entities do you want to access (e.g., students, schools)?
What: What level of the content area is being investigated (e.g., Mathematics, reporting categories)?
When: Which administration data would you like to review?
Users navigate throughout Interactive Reports on the ORS using the Navigation Tool, which is present wherever you see a magnifying glass. The Navigation Tool give you access to three dimensions of data: Who, What and When. Who includes which entities you want to access such as students and schools. What includes the level of the content area being investigated such as Math and reporting categories. When allows you to select an administration period. You can move through these dimensions using the Navigation Tool.

12. Navigation Tool
Here is an example of the Navigation Tool, which has three dimensions of data. The navigation tool options available to each user vary based on User Role. Users will select options from the drop down menu and click View to review data.
For the Who dimension, users can navigate along the levels shown here in the blue chain. For example, District Assessment Coordinators can view information from the district level all the way down to the student level. Levels included here are State, District, School, and Student.
For the What dimension, users can choose which level of content detail to view for the given subject. For example, for the FSA Mathematics, you can choose to view test result information for the test at the subject level or the reporting category level.
For the When dimension, users can choose the administration for which they would like to review data.

13. Online Reporting System Florida Standards Assessments
Using Reports & Files and Interactive Reports and features

14. Logging in to ORS Access the FSA portal at www.fsassessments.org.
Click the Online Reporting System (ORS) icon to be directed to the System Login page.
Enter your username ( address) and password.
Click Secure Login.
To log in to ORS, go to the FSA Portal. Click the ORS icon on the right side of the screen and log in using the Secure Login (same Login as TIDE).

15. Welcome Page
When you first log in to ORS, the Welcome page is displayed that allows you to select the type of reports that you want to view. To view interactive reports, click the [Interactive Report] button. To view participation data, click the [Participation Report] button. You will be taken to the appropriate report based on your selection.
To view static reports click the either [Interactive Report] or [Participation Report] button. You will be directed to a page where you can select any type of reports and files.

16. Use the dropdown to choose the function you would like to use.
Reports & Files
Use the dropdown to choose the function you would like to use.
In order to access Report & Files tab, users can click on either the [Interactive Reports] or the [Participation Reports] button on the Welcome Page. At the top of the screen, you will see a banner that provides links to all ORS reports and features. The banner at the top of the screen will be available throughout all of ORS.
All items available for use on the banner:
The [Interactive Reports] button links to the Home Page Dashboard screen.
The [Reports & Files] drop-down menu displays the following options: (1) Participation Report; (2) Test Completion Rates; (3) Retrieve Student Results; and (4) Retrieve Aggregate Results.
The [Inbox] button links to the Retrieve Student Results screen where you can access data files and static reports.
The [Search Students] button opens a pop-up window that allows you to search for a student by SID or by first or last name and access his or her test results. Please note that for this school year, the SIDs will be masked with X’s, however users will still be able to search using the full SID number.
The banner also consists of several tools. The tools that are available may vary from screen to screen.
The [Help] button links to ORS User Guide. When you click the [Help] button, ORS User Guide is displayed in a new tab. This is a useful resource for learning more about system capabilities or for answering questions about where to find certain data.
The [Print] button enables you to print the current screen. When you click the [Print] button, a dialog box is displayed that enables you to specify your print options. The dialog box may vary slightly depending on the browser that you are using.
The [Export] button enables you to export the data displayed on the current screen. The data is exported in a Microsoft Excel (.xls) file.
The [Definitions] button provides definitions for terms specific to the report you are viewing. This button may not appear on every screen. When you click the [Definitions] button, a pop-up window appears. This window contains definitions of the different terms used in the report. To close the pop-up window, click the [X] button in the upper right corner.
The Reports & Files will help users manage and monitor online testing in the Online Reporting System and download data files and static reports. The Reports & Files feature of ORS is where users will be able to access data files and static reports.   
To access the [Reports & Files], click the link visible at the top of all pages in ORS.
The Reports & Files displays four tabs:
Retrieve Student Results – This tab also leads users to the inbox feature in addition to the retrieve student results section. The inbox is where users will be able to find data files and any other reports on the [Reports & Files] they choose to download.
Retrieve Aggregate Results – this tab allows users to access state and district level aggregate reports.
Participation Report
Test Completion Rates

17. Reports & Files: Retrieve Aggregate Results
Choose the specific report you would like to download and what you would like to view (test, administration, and grade).
Selecting the [Retrieve Aggregate Results] tab will direct users to a page from which they can download the following static reports: (1) State Summary; (2) State Report of Districts; (3) State Report of Schools; (4) District Summary; and (5) District Report of Schools.
Once on this page, the user will need to choose the specific report he or she would like to download and what they would like to view (test, administration and grade). After the parameters have been selected, clicking [Download Report] will prompt the system to begin creating the report.
When the report has been generated, it will appear in the user’s inbox (My Inbox) shown in the previous slide. The user can then download the report and view it.

18. Reports & Files: Retrieve Student Results
Choose What and Who to include in data file
Download completed data file
Choose a file format
Click Download File
Selecting the [Retrieve Student Results] tab will direct users to a page from which they can build custom downloadable data files for groups of students.
Once on this page, the user will need to complete Steps 1 and 2 displayed at the top of the page to choose what they would like to view (test, administration and grade) and whose results they would like to view. After the parameters have been selected, clicking Download File will prompt the system to begin creating the file.
When the file has been generated, it will appear in the user’s inbox (My Inbox), shown here at the bottom of the slide. The user can then download the file and view it in either fixed width or Excel format. Remember, users can access their inbox from any page in ORS by clicking the Inbox icon. This inbox is only for ORS and is used to retrieve these student data files, as well as any static reports (e.g., State Report of Districts, District Report of Schools).
My Inbox will also be used to access DSR, SAR, DAR, and similarity results files in the summer, as these data files will be posted in the user’s inbox (based on the user’s role and level of access). Unlike custom-generated files that will be available for 30 days, these files will be available for the duration specified by FDOE.
Data file has score report data across subject. File is available for 30 days. User is alerted by when the file is ready.

19. Reports & Files: Participation Report
Choose What and Who to include in report, then filter with specific information about student’s participation.
Selecting the [Participation Report] tab will take the user to a page from which detailed participation reports can be accessed for all online tests. As shown on this slide, the user can build a custom report by choosing among a list of options for the type of data he or she wants to view.
As with the other reports, users will need to first choose what test to include in the report output as well as whom to include in the report. The report can be generated for only one computer-based test at a time.
Display onscreen or export to Excel

20. Reports & Files: Participation Report
Once the user has made the appropriate selections and clicked the [Generate Report] button, the output table will display results. This Participation Report output example shows the list of students who have completed the Grade 5 FSA Mathematics test. Note that the user will search for the completed status to determine if students have completed testing.
With these results, District Assessment Coordinators and school personnel can track participation and student results across the district or school.
Note that participation reports are available only for computer-based tests.

21. Reports & Files: Test Completion Rates
Test Completion Rates provide a high-level view of how many students have started and completed all possible tests by school, district, or state (limited to the user’s level of access). This is a quick way for district assessment coordinators to track schools’ participation. To see which individual students have or have not completed a given test in a school, the user can view the reports in Participation Report.
Select reports by schools or district to see the number of tests started/completed

22. Interactive Reports: Home Page
Click on any data element for a particular grade and subject to view more data.
If you select Interactive Report from the Welcome page, you will be directed to the Home page, which will automatically display the information that is applicable to your user role. The page shown here displays the Home page for a school administrator.
To navigate to a specific assessment data, select a test, administration, and a school for which you would like to see results. On the bottom of the screen, a dashboard will appear with the results based on your selections. The number of students and the mean t score will appear for each subject and grade. To further explore the data, select the grade and subject you wish to explore from either table. As an example, we will select the Grade 3 FSA ELA.

23. Interactive Reports: Subject Detail Page
The titles describe the page and table in detail.
The table shows data for the user’s access level (in this case, Demo District).
The user will be directed to the subject-level data for the selected grade and subject, in this case, Grade 4 FSA ELA. This report provides information about groups of students and mean T Scores.
The page will be accompanied by a detailed title describing the data being viewed as well as the name of the test and administration window.
The table displays comparison data for all the higher levels of the data, such as the state, and data for all the entities at the current level of the Who dimension. For example, we may see a list of schools (if the user is a district-level user).
In each column, the headers will tell you the exact data being displayed. The first column displays the number of students who have completed the test at each level of aggregation. The second column displays the mean T scores.

24. Exploring Subject-Level Data
The data can be disaggregated by Enrolled Grade.
The data in this and other tables in ORS can be sorted in a number of ways. On most table columns, the data can be sorted in ascending or descending order simply by clicking the column header.
For any aggregated data, the data can also be disaggregated by Enrolled Grade using the Breakdown By drop-down menu.

25. Exploring the Data: Using the Navigation Tool
Click the magnifying glass to explore the data
From this subject detail page, users can begin to use the Navigation Tool by clicking the magnifying glass icons next to the district or school names. The Navigation Tool is the main method for moving between reports and deciding which type of data you would like to view.
Simply click the magnifying glass to access the Navigation Tool. It will appear as a pop-up box on the page, as shown here at the bottom center of the page.
The next sections will show how to explore the data on three different dimensions: Who, What, & When.

26. Navigating the Who Dimension
Click [STUDENT] from the drop-down menu to go to the Student Listing page.
This page shows the information a district user would see on the Subject Detail Report. The example here lists Demo School 1 and Demo School 2 as schools. To view students for Demo School 1, the user would navigate from the subject detail page by clicking the magnifying glass next to the school’s name and selecting [STUDENT] from the drop-down menu.
Click the magnifying glass next to school

27. Student Listing Page
We can now see a listing of all the students for this particular school (Demo School 1). The Student Listing page, which is the School Report of Students, lists individual data for each student in the selected school. Instead of only aggregate data and mean scores, this page also contains testing data on individual student performance.

28. Batch Printing Individual Student Reports (ISRs)
The [Print] tool on the Student Listing page allows you to print the current screen and also allows you to generate a PDF file of individual student reports for all the students in the school. When you click the [Print] button on the Student Listing page, a pop-up window is displayed that enables you to specify the report you wish to print. To print the data displayed on the screen, click the [Print this page] button. To generate a PDF report of all the listed students, click the [Print Individual Student Reports] button. The PDF reports can be accessed from the Inbox section of the Retrieve Student Results screen.

29. Navigating the Who Dimension
Click [STUDENT] from the drop-down menu to go to go to the ISR page.
From the Student Listing page, the user can navigate all the way down along the Who dimension to access the individual student report page. To view a particular student’s report, the user would navigate from the Student Listing page by clicking the magnifying glass next to the individual student’s name and selecting [STUDENT] from the drop-down menu.
Click the magnifying glass next to a student

30. Individual Student Report (ISR)
This table shows the student’s test performance.
This table shows the student’s performance in each reporting category.
The Individual Student Report page provides a summary of all reporting data for an individual student. The student’s T score and percentile rank are shown in the table at the top of the page. The table at the bottom of the page displays information on the student’s performance in each reporting category for the subject.
It is important to note that the only way to access and print an Individual Student Report is through the Interactive Report feature of ORS.

31. Navigating the What Dimension
Click [Reporting Categories] from the drop-down menu to go to the Reporting Category Detail page.
Click the magnifying glass
We will now explore how to navigate the What dimension. Along the What dimension, users can choose which level of content detail to view for the given subject. For example, you can choose to view student test result information at the subject level or the reporting category level. In this example, we will use the Navigation Tool to explore the reporting category level.

32. Reporting Category Detail Page
Data are presented for each reporting category.
The user is taken to a Reporting Category Detail page. This page provides data on how students performed on specific reporting categories within a subject. Such data can help schools and districts further identify possible areas of strengths and weaknesses within a subject.

33. Things to Remember
To generate static aggregate reports (e.g., State Summary, District Report of Schools), you can navigate to Reports and Files and select Retrieve Aggregate Results.
Inbox is used to download DSR, SAR, DAR files, as well as any static reports.
To view School Report of Students and Individual Student Reports, you can navigate to Interactive Reports and drill down to Student Listing Page and Individual Student Report page.

34. Things to Remember
The magnifying glass icon indicates what data can be further explored in the Interactive Reports.
All tables can be printed and exported in the Interactive Reports.
The Help (User Guide) button is available for every page of the ORS.

35. Paper Score Reports
Students who participate in a computer-based or paper-based assessment will receive a paper Score Report.
Paper Reports will be sent to districts.
Schools will distribute the reports to students.
Students who participate in a computer-based or paper-based assessment will receive a paper Score Report. These student scores will also appear in ORS. Paper Reports will be sent to districts. They will then distribute them to schools who will then send/distribute them to students.

36. Online Reporting System Resources
ORS User Guide
FSA Quick Guide
Other resources to help with the administration of FSAs will be available soon on the FSA Portal. Please check the FSA portal frequently for up-to-date information.

37. Online Reporting System Florida Standards Assessments
Accessing Help and Support

38. Contact Us FSA Portal: www.fsassessments.org Email:
Toll-Free Phone:
Hours:
7:00 a.m.–8:30 p.m. (ET)
Monday–Friday (except holidays)
This concludes the ORS Webinar. More detailed information on TIDE, the Test Delivery System, and ORS can be found in the User and Quick Guides posted in the FSA portal. If you need additional assistance, please contact the AIR Help Desk.
Hours: 7:00 a.m.–8:30 p.m. (ET) Monday–Friday (except holidays)