1. Teacher Training Module Three Teacher Tools: Tools & Analysis
Module Three of Teacher Tools training will go over Tools & Analysis.
Lake County Schools
February 17, 2019
Paula Wicker Planning, Evaluation & Accountabiliy

2. Teacher Tools Tab: Tools & Analysis
There are five major areas under Tools & Analysis:
Instructional Tool
Exam Label Generator
Item Analysis
Item Response Report
In-Class Performance
We will walk through each of these areas. First let’s look at Instructional Tool.

3. Instructional Tool will allow you to:
Generate standards-based instructional materials for students based on their performance on tests.
Instructional materials can include missed exam questions, resource materials, and additional standards-aligned questions.
**Warning: Creating a worksheet with missed exam questions can be done easily. However, creating a practice worksheet from the instructional resources bank may take patience to find quality. Remember, it is pulling from a huge bank where anyone can enter lesson plans, some good and some bad**
Before getting started in the Instructional Tool area, it important to note that one of the resources that the system can access to create customized worksheets for the students is the Edusoft Instructional Resource Bank. This bank is huge and houses thousands of lesson plans, worksheets, activities etc. Every teacher across the state of Florida who has access to Edusoft may enter their own resources- some good and some not so good. You will be prompted as to where you want to pull resources from for your worksheet. Use caution when using this resource bank as it may take time to weed through the resources to find quality items.
With that being said, this feature does allow you to pull missed questions from all the tests that the student has taken and create a worksheet with just those questions. It will even include the correct answer if you choose that option. This feature does work well and can be quite useful to the student as well as the teacher.

4. Instructional Tool 1 2
To create a worksheet using the Instructional Tool-
Step 1: You will be prompted to choose a worksheet for Individual students, each class or period or a groups of students.
Step 2: You will then have to select a period and choose either all students from that period, individual students from that period or students from that period filtered by demographic options.

5. Instructional Tool 3 4
Step 3: Choosing individual students will allow you to customize a worksheet for each student based on the test questions that he/she missed or by benchmarks that the student/s performed poorly on. You will see all the students in the chosen class and be allowed to either select all or choose individual students from the list.
Step 4: Next, you can choose which tests to include. You will be able to see only the tests which the student/s you chose have taken.

6. Instructional Tool 5 6
Step 5: You will be shown the standards covered on the test/s that you have chosen. The number to the right is the average score from your class on that standard. You will be able to check the standards that you want to include question/s or activities for on the worksheet.
Step 6: You will have the option of choosing to list lowest-performing students, missed questions, reassessment items, or instructional resources.

7. Instructional Tool 7
Step 7: This screen shows you what will appear below Instructional resources should you check that box. You can see Types of resources, Skill Levels of the resources and Sources from which to pull the resources. Note the middle choice under “Sources:”. Once we have district approved exemplar lesson plans housed in the system, this would be the best choice for pulling resources.

8. Instructional Tool 8
Step 8: You will then be able to preview what you have chosen. You will be able to view the student worksheet or the teacher worksheet.

9. Your Turn
Pick a test you have scored and create a worksheet missed test questions.
Now create a worksheet with instructional resources.
Remember not to choose the Move button on the bottom right. The Move button will allow you to move among your own folders that you’ve created under My Tests, but will not allow you to move a test from the Shared Tests or District Tests folder into your My Test folder. You can only COPY a test from those folders into yours.
You can delete the test you copied into your My Tests folder by highlighting the test name on the right and clicking the delete button.

10. Exam Label Generator
Now let’s look at the Exam Label Generator.

11. Exam Label Generator will allow you to:
Generate labels for tests you have administered and graded.
Place labels on answer sheets to report student scores and identify standards at-risk
You will be able to generate labels with student scores that can be printed onto Avery sticky labels or just printed out on regular paper for the student.

12. Exam Label Generator 1 2 To generate a label-
Step 1: Choose the period for which you want the labels.
Step 2: Choose the test for which you want the labels.

13. You can then print your scores/info below onto Avery labels:
Exam Label Generator 3
You can then print your scores/info below onto Avery labels:
Step 3: You can choose to show the correct answer on the labels.
You can then see the labels before you print them. You can see that the number of questions missed out of the total number of questions, the percentage score, the concepts needing attention and the correct answers for the missed questions. This would be very beneficial for students as well as teachers.

14. Your Turn Create Labels for a test that you have scored.
Remember not to choose the Move button on the bottom right. The Move button will allow you to move among your own folders that you’ve created under My Tests, but will not allow you to move a test from the Shared Tests or District Tests folder into your My Test folder. You can only COPY a test from those folders into yours.
You can delete the test you copied into your My Tests folder by highlighting the test name on the right and clicking the delete button.

15. Item Analysis Report
Next let’s look at the Item Analysis Report.

16. Item Analysis Report will allow you to:
See the difficulty level of each question
See exactly which students missed each question
See what distracter was picked the most and analyze all choices to determine why
See the discrimination value of each question
Determine the reliability of your assessment
Determine the validity of your assessment
The Item Analysis report can be one of the most beneficial reports to a teacher. Before having this system many teachers performed this type of analysis by hand which can be very time tedious and time consuming. With Edusoft it can be done with a few clicks.

17. Item Analysis Report 1 2 You can filter by these areas
To access an Item Analysis Report on an assessment:
Step 1: Go to the My Tests folder and choose the test you wish to see the analysis for (this can be done for benchmark tests as well)
Step 2: Select what periods you would like to view the analysis for, it is suggested to view all first and then filter by specific period and then demographic groups.
Next click run report now. Note that on this screen you will see “Schedule report and “Save report options”. Once you become familiar with working with this report, you may choose either of these two options. “Schedule a report” will allow you to set up a day in the future to run a report. You simply choose the options you want to see and it will run the report on that day. “Save report options” will allow you to save a report that you find you will use often. Once you run that report once and save it, you will have the option from the original report to choose to access other groups of students with one click and get the same report.
You can filter by these areas

18. You can filter this report by these areas.
Item Analysis Report
You can filter this report by these areas.
See what psychometrics can be determined from your student data.
Click on the blue numbers and see a list of students that chose that answer
Here you can see what valuable information that can be gained from the Item Analysis Report. Also note that you can still filter your report from this page. Using the top box, you could filter by Ed Programs (FCAT Levels, ESE, LEP etc), gender, periods, grades, ethnicities or custom groups. (You may not have trained yet on creating a custom group, but you would have to have created a custom group before choosing that option).
You can click on the blue underlined numbers under the answer choices to see a list students who chose that particular answer. This will give you valuable information on your students. For example, if half your students chose a certain incorrect answer, you would want to investigate to see why that distracter was misleading to your students and remediate/re-teach based on that information.
You will also be able to see the difficulty of each question (p-value), the discrimination value of each question, and the Kuder-Richardson 20 reliability value of the entire exam. It is important to look at “what do these terms mean?” as most of us are not psychometric experts. However, the good new is, that once you read over (a few times!) the definitions of these terms as they relate to the data in front of you, you will feel like an expert! You will also have peace of mind knowing that you have a tool that with a few clicks can determine whether your assessments are valid and reliable.
Asterisk indicates the correct answer

19. Your Turn
Create an Item Analysis Report for a test that you have scored.
Click on a blue underlined number to view a list of students who chose that answer.
Sort by % Correct.
Remember not to choose the Move button on the bottom right. The Move button will allow you to move among your own folders that you’ve created under My Tests, but will not allow you to move a test from the Shared Tests or District Tests folder into your My Test folder. You can only COPY a test from those folders into yours.
You can delete the test you copied into your My Tests folder by highlighting the test name on the right and clicking the delete button.

20. Item Response Report
The Item Response Report looks similar to the Item Analysis Report however does not go into the detail that the Item Response Report does.

21. Item Response Report
Item Response Reports show you individual students' responses to assessment items as well as the most commonly selected distracters for each class. They also show how each assessment item aligns to specific state standards or question groups.
This report also allows you to export your data to Excel.
The Item Response Report will show you how each individual student responded to each question, the most common distracter the class chose and standards that align to each question. This report is also exportable to excel which makes it very valuable should you want to manipulate the data. This is a report that once manipulated correctly should be able to be uploaded into Esembler. (that is another training but something to remember)
An important feature of the Item Response Report is that once you get a report generated you can easily see a Class-List Report and a Performance Band Report with one click.
**Also note that the Item Response Report will allow you to view to a Class List Report and a Performance Band Report**

22. Item Response Report 1 2 To view an Item Response Report:
Step 1: Choose the folder and the test.
Step 2: Choose your report options. Make sure to include the student ID if you plan to upload to Esembler later.

23. Item Response Report 3
Note the filter options available.

24. Item Response Report 4
There are three ways to view the Item Response Report: Web page, Spreadsheet or Printer-friendly. Spreadsheet is exportable to excel.
Choose how you want to view your report. Choose Spreadsheet and it will export to excel.

25. Spreadsheet Report will look like:
Item Response Report
Spreadsheet Report will look like:
This is an example of the Item Response Report.

26. *You can also choose and report on another period or class**
Item Response Report
A Printer Friendly Report allows you to switch to other types of reports:
On the Printer Friendly Report you will be able to quickly choose options to switch to: Performance Band Report, Class List, or Item Analysis. This is an excellent way to quickly get several reports.
*You can also choose and report on another period or class**

27. Example of Performance Band Report:
The Performance Band Report gives you quick look at how all or a select group of your students scored overall. This does not contain student names so it is the report many schools use for their data chats.

28. Example of a Class List Report:
A Class List Report has many options, this one is shown with color bands. You can see how each student performed on each benchmark.

29. Your Turn
Create an Item Response Report from a test that you’ve scored and view it in Printer-friendly mode.
Switch to a Performance Band Report, then a Class-List Report.
Remember not to choose the Move button on the bottom right. The Move button will allow you to move among your own folders that you’ve created under My Tests, but will not allow you to move a test from the Shared Tests or District Tests folder into your My Test folder. You can only COPY a test from those folders into yours.
You can delete the test you copied into your My Tests folder by highlighting the test name on the right and clicking the delete button.

30. In-Class Performance
Next let’s view an In-Class Performance report.

31. In-Class Performance will allow you to:
View in-class performance report for tests you have administered and graded.
Determine what standards need more attention and how thorough your standard coverage was.
The In-Class Performance report is another way to get valuable information on how your students performed. This report will point out what standards may need more attention.

32. In-Class Performance You can choose a regular or advanced report.
To view an In-Class Performance Report:
Choose the period you want to see.
You can choose a regular or advanced report.

33. Regular Report will look like:
In-Class Performance Report
Regular Report will look like:
The first part of the report shows Class-wide performance.
You will then see the report for your class and below that the report for individual students in that class. The report will show you the “standards at risk.
The second part of the report show performance by each student.

34. Advanced In-Class Performance Report
The Advanced Report will look the same. The difference is that you are able to filter by Standard, Period/s, or Test/s.
The advanced In-Class Performance report will show you the same information but allow you to filter by Standard, Periods or Tests.

35. Your Turn
Create in In-Class Performance Report for a test that you’ve scored.
Remember not to choose the Move button on the bottom right. The Move button will allow you to move among your own folders that you’ve created under My Tests, but will not allow you to move a test from the Shared Tests or District Tests folder into your My Test folder. You can only COPY a test from those folders into yours.
You can delete the test you copied into your My Tests folder by highlighting the test name on the right and clicking the delete button.

36. Questions?