1. IAA 2010 Teacher/Coordinator Training

2. Introductions
Pearl Schneider – IAA Coordinator, ISBE
Jessica Dare – IAA Special Education Consultant, ISBE
Chad Curtis – Program Manager, Pearson

3. What are we going to discuss today?
Calendar of Events
Test Preparation
Task Administration
Online Scoring
Materials Management

4. 2009-2010 IAA Calendar of Events
Now until December 21, 2009
- Profile update window for Assessment Network (ONLY opportunity to update contact and shipping info before Spring 2010 testing!!)
January 4, 2010
- IAA Regional Training registration opens via the Assessment Network website
January 5, 2010
- Additional IAA Webinar Training for teachers/coordinators familiar with past IAA testing
January 8, 2010
- Last day for districts to update SIS with information to be included in the pre-id file to Pearson. (used for initial shipment of materials and SchoolSuccess)
January 19-29, 2010
- IAA Regional Trainings for New Teachers and Coordinators

5. 2009-2010 IAA Calendar of Events (cont)
January 29, 2010
- SchoolSuccess user ID & password ed to IAA Coordinator
February 1, 2010
- SchoolSuccess website opens to allow teacher account
creation/classroom setup
February 8, 2010 – Test materials delivered to districts
Feb 8 – March 15, 2010: Additional Orders (test books only)
- Available on Assessment Network website

6. 2009-2010 IAA Calendar of Events (cont)
February 22 – March 19, 2010: Single Test Administration Window
March 19, 2010: SchoolSuccess website closes at 11:59 p.m.
March 24, 2010: Pre-scheduled pick-up via FedEx
- Materials picked up from the original delivery
destination
- Materials must be returned to IAA Coordinator prior to
this date
- To change pickup date, contact Pearson

7. Test Preparation

8. IAA Preparation Resources
Test booklets:
Detailed Teacher Instructions
Artwork to use and/or adapt
Required concrete objects
Updated Implementation Manual
IAA Rubric

9. How to Assess If necessary for the student’s access to the test, use:
Enlarged art
Hand-held manipulatives (coins, string, blocks, etc)
Visual aids and assistive technology as needed
Tactile forms of print and/or raised-line materials
Computer graphics as needed
Extra time and additional breaks for test taking in a quiet setting
Professional staff familiar to the student to administer the task WHILE THE TEACHER SCORES.

10. How to Assess
Identify the student’s primary mode of communication and administer each task using this mode.
Verbal
Nonverbal
Sign Systems
Communication Books
Assistive Technology
Language issues (e.g., ELL)

11. How to Assess
Use sample items to familiarize the student with the test format
Discuss/explain to the student what he/she will be asked to do during the assessment.
Provide the student with easy access to communication device(s), if typically used.
Review content-related pictures, words or voice output on the student’s communication system prior to beginning.
Ensure that hearing aid(s) and/or FM systems are in good working order.
Eliminate competitive sounds or visual distractions that may divert the student.
Position the student to sustain attention.
Determine the best focal distance for the student to view/manipulate the materials.

12. How to Assess
Avoid cuing answers through body language, voice, or position of objects.
Maintain the wording or content of the task.
Stay true to the student task as written in the test booklets.
Maintain the wording or content of the answer choices. Present the answer choices in order.

13. Task Administration
Before we begin, just a reminder: You may type in questions at any time during this presentation. Actually this may be a good way to be sure none of your questions get missed.
In the event there are teachers and coordinators who are new to the IAA, I will try to move through the task administration portion of the webinar at a moderate pace. Those of you who are IAA veterans, please bear with me.

14. IAA Scoring Rubric Score Levels
The student correctly performs the primary task without assistance or with a single repetition of instructions or refocusing. The teacher can repeat the instructions without change one time (no additional prompting and no indication of right or wrong answer).
The student correctly performs the primary task with the general prompt.
The student correctly performs the primary task with a specific prompt.
The student does not perform the primary task at Level 2 or provides an incorrect response despite Level 2 support.
The tasks that follow are constructed for the purpose of promoting precise administration and scoring of the 2010 IAA. The teacher instruction design is actually the IAA Scoring Rubric that has been embedded into the tasks. As you can see from the descriptions on the rubric, the score levels are meant as a blueprint or structured guide to testing and scoring throughout all subjects, grades and levels of ability.

15. Built-In Task Characteristics:
Specific texts, symbols, and artwork are embedded in the task.
The General Prompt is embedded in the task (in the event it is needed).
All tasks follow the same rubric “template” for teacher administration instructions.
Flexibility in presentation of tasks and how the student responds will be maintained.
While it is expected that some students will require accommodations to access the test, it is our hope that most students will be able to use the material provided within the testing booklets and thereby, alleviate some of the prep work for the teachers. If a student requires accommodations to allow access to the test, the specific text, symbols and artwork must never be changed to other than the original content. For example: some students may respond to color pictures or photographs rather than the black and white drawings provided. These colored images may be used instead of the booklet’s drawings only if they do not change the meaning of the questions or the answer choices presented. The general prompt is also provided for each task, so that teachers are using the same prompts throughout the third level of testing or scoring. Accessibility to the test is very important and the student’s mode of communication in presentation and response should be accommodated at all times.

16. Task Administration 2010 IAA Task Layout:
Page facing teacher – instructions and text
Page facing student – task and/or answer options
Teacher Page
Student Page
The layout of the tasks in the booklets is illustrated in this slide. While the teacher reads from the page facing him or her, the student is presented with the task and the answer choices on the page facing the student.

17. Sample of Teacher Instructions (Embedded General Prompt)
• Present the primary task to the student. Say: “Primary Task.”
• Point to each option and say: “Choice A,” “Choice B,” “Choice C”
The student receives a score of 4 for a correct response.
If the student does not respond or responds incorrectly, repeat the primary task only once exactly as it appears.
If the student responds correctly after the second presentation of the primary task, the student receives a score of 4.
If the student again chooses an incorrect answer or does not respond, move to Level 3. 4
• Say the general prompt to the student: “General Prompt.”
• Re-present the primary task and answer options.
The student receives a score of 3 for a correct response.
If the student does not respond or responds incorrectly, move to Level 2. 3
•Indicate the correct answer and re-present the primary task, and answer options.
The student receives a score of 2 for a correct response.
If the student does not respond or responds incorrectly, move to Level 1. 2
If the student does not respond or responds incorrectly at Level 2, the student receives a score of 1. 1
Here is a sample of the teacher instructions that will appear on the first page of all tasks. As you can see the rubric language appears in regular print. These are the instructions to the teacher. The statements and answer choices that the teacher reads aloud to the student are in bold type. Let’s walk through this sample task. The teacher is directed to present the primary task and the 3 answer choices to the student. If the student responds correctly, the student receives a score of 4. If the student does not respond or answers incorrectly, the teacher repeats the same primary task and answer choices exactly as written. If the child responds correctly this second time, he/she scores a 4. If the student does not respond or responds incorrectly, the teacher moves to the general prompt or level 3 section. After the general prompt is delivered, the teacher repeats the primary task and 3 answer choices. If the student responds correctly, the student is scored a 3 on this task. If the student does not respond or responds incorrectly, the teacher moves to the instructions in level 2 and provides a specific prompt. Basically the teacher tells the student the correct answer and then administers the primary task and answer choices again. If the child responds correctly this time, the student is scored a 2 on the task. If the student does not respond or responds incorrectly, the student is scored at a 1 on this task.
Answer: Correct answer

18. Sample of Teacher Instructions (General Prompt on 3rd page)
• Present the primary task to the student. Say: “Primary Task.”
• Point to each option and say: “Choice A,” “Choice B,” “Choice C”
The student receives a score of 4 for a correct response.
If the student does not respond or responds incorrectly, repeat the primary task only once exactly as it appears.
If the student responds correctly after the second presentation of the primary task, the student receives a score of 4.
If the student again chooses an incorrect answer or does not respond, move to Level 3. 4
• Turn the page to present the general prompt.
• Re-present the primary task and answer options.
The student receives a score of 3 for a correct response.
If the student does not respond or responds incorrectly, move to Level 2. 3
•Indicate the correct answer and re-present the primary task, and answer options.
The student receives a score of 2 for a correct response.
If the student does not respond or responds incorrectly, move to Level 1. 2
If the student does not respond or responds incorrectly at Level 2, the student receives a score of 1. 1
The same teacher instructions appear on this IAA task example. However, in the general prompt or level 3 section, the teacher is directed to turn the page to find the general prompt. The teacher repeats the same pattern in administration as in the previous example but the general prompt is not found on the first page of the task. You probably already noticed that the correct answer is provided to the teacher at the bottom of p. 1 in each task.
Answer: Correct answer

19. Here is an example of a Gr
Here is an example of a Gr. 7 Science task that uses the first “General Prompt” format we looked at. Let’s look at the student page as I read the teacher’s text and we’ll work through this task together.

20. “Earth moves around the Sun in a path called an orbit
“Earth moves around the Sun in a path called an orbit. How much time does it take for Earth to complete one orbit of the Sun?”, “One day, One week, One year.” If the student responds with the correct answer, a score of 4 is given and the tester moves to the next task. If the student is incorrect or does not answer repeat “Earth moves around the Sun in a path called an orbit. How much time does it take for Earth to complete one orbit of the Sun?” “One day, One week, One year.” If the student answers correctly this time, a score of 4 is earned. If the student is incorrect or does not respond, move to the general prompt: “Each time Earth makes one orbit of the Sun, you have a birthday.” “Earth moves around the Sun in a path called an orbit. How much time does it take for Earth to complete one orbit of the Sun?” “One day, One week, One year.” If the student answers correctly, a score of 3 is earned. If incorrect or no response, the teacher moves to level 2 and tells the child the correct answer “An orbit of the Earth takes one year”, “Earth moves around the Sun in a path called an orbit. How much time does it take for Earth to complete one orbit of the Sun?” “One day, One week, One year.”. If correct at this level, a score of 2 is earned. If incorrect or no response, the student receives a score of 1.

21. This third grade Math task is an example of the second general prompt format we saw. As in the previous example, the teacher and student begin the task with the information on p. 1 and 2 of the task. In the event the student requires the general prompt on this task, the teacher turns the page to reveal the teacher instruction page and the student’s information page for the general prompt. Follow me through a review of the procedures for this task.

22. Here is the primary task:
“Here is a table titled, “Snack Choices.” The choices are yogurt, crackers and apples. How many students chose crackers?” 1, 4, or 6” Let’s assume the student is incorrect or fails to answer twice, so we move to the general prompt on the next page.

23. The teacher reads from this page while the student sees

24. “Here is a different table, titled “Favorite Class
“Here is a different table, titled “Favorite Class.” The classes are Art and Music. 5 students chose Art as their favorite class.” The teacher turns the page back to p. 1-2 and repeats the primary task.

25. SCIENCE
Below is a list of materials that will be needed to present certain tasks in this section of the test.
Task 1
long balloon
plastic soda straw
string
tape
Each subject in the test booklet is preceded by a divider page. Science and Math tasks may require the use of manipulatives. The list of the items required for a specific task will appear on this cover page. These manipulatives MUST be used for these specific tasks. However, if your student is accustomed to using manipulatives and requires them to access a task, concrete objects may be used for ANY task the teacher deems necessary. The listing on the divider page is meant to allow teachers easy access and alleviate the need to search through the whole booklet in advance. Some Science tasks may require prior setup of an experiment. The following task illustrates what to expect.
SCIENCE

26. The format of the teacher instructions does not change
The format of the teacher instructions does not change. However, you notice an additional instruction at the beginning of this Science item. This directs the teacher to turn the page to find the list of items required, how to assemble the experiment and how to present it to the student.

27. Since in this case, the primary task is to observe the experiment and make decisions based on the experiment, only the three answer choices appear on the student p. 2 of the task.

28. Here you find the same list of items that appeared on the subject divider page. Beneath the list are the directions on how to set up the experiment including a drawing illustrating how it should look upon completion. In this experiment, the teacher releases the balloon so that the air propels the balloon along the string. Depending upon the accuracy of the student’s responses, the experiment must be repeated within the primary task as often as the student moves through the scoring levels.

29. Sample Score of 4 Brian, 4th Grade Reading
The following are examples of the administration and scoring of IAA tasks at each scoring level. In order to access an IAA video, the following slides provide the sample task and how to access the video at a later time and at your convenience.
Please do not try to access the videos during the live webinar.

30. For Brian, here is the Gr. 4 reading task you will see in the video
For Brian, here is the Gr. 4 reading task you will see in the video. This is the p. 1 teacher instructions for the task.

31. And this is p. 2, the student facing page Brian is using.

32. Click → http://www.isbe.net/assessment/iaa.htm
2010 IAA Test
IAA Calendar of Events  
IAA Teacher Trainings: Locations and Dates  
IAA Teacher Training Refresher Webinar: Dates  
IAA Teacher Training PowerPoint (Coming Soon)
IAA FAQs  
IAA 2010 Score Sheet with Accommodations Documentation        
IAA Performance-Based Rubric   (Updated 10/08)
IAA 2010 Implementation Manual  
IAA Sample Scoring Videos  
Level 4 ←
Level 3
Level 2
Level 1
IAA Sample Tasks
2010
2009
At a later time, please go to the website shown at the top of this slide and scroll down to the Level 4 video indicated by the red arrow.

33. Sample Score of 3 Charles, 7th Grade Science
In the Level 3 video, you will observe Charles who is testing on the Science task we saw earlier about the length of time required for the Earth to orbit the Sun.
Please do not try to access the videos during the live webinar.

34. Here is the task the student is taking

35. And this is the student page he is viewing.

36. Click → http://www.isbe.net/assessment/iaa.htm
2010 IAA Test
IAA Calendar of Events  
IAA Teacher Trainings: Locations and Dates  
IAA Teacher Training Refresher Webinar: Dates  
IAA Teacher Training PowerPoint (Coming Soon)
IAA FAQs  
IAA 2010 Score Sheet with Accommodations Documentation        
IAA Performance-Based Rubric   (Updated 10/08)
IAA 2010 Implementation Manual  
IAA Sample Scoring Videos  
Level 4
Level 3
Level 2
Level 1
IAA Sample Tasks
2010
2009
Please use the same website shown at the top of this slide and scroll down to the Level 3 video indicated by the red arrow.

37. Sample Score of 2 Sarah, 3rd Grade Writing
Sarah will be taking a writing task at the 3rd grade level. The task is asking the student to determine the correct ending punctuation.
Please do not try to access the videos during the live webinar.

38. Here is the teacher page asking the student to choose ending punctuation

39. And this is the student page the child views
And this is the student page the child views. You will notice in Sarah’s case, the teacher has cut up the student page to assist the student in accessing the task.

40. Click → http://www.isbe.net/assessment/iaa.htm
2010 IAA Test
IAA Calendar of Events  
IAA Teacher Trainings: Locations and Dates  
IAA Teacher Training Refresher Webinar: Dates  
IAA Teacher Training PowerPoint (Coming Soon)
IAA FAQs  
IAA 2010 Score Sheet with Accommodations Documentation        
IAA Performance-Based Rubric   (Updated 10/08)
IAA 2010 Implementation Manual  
IAA Sample Scoring Videos  
Level 4
Level 3
Level 2
Level 1
IAA Sample Tasks
2010
2009
Again use the same website and scroll down to the Level 2 video indicated by the red arrow.

41. Sample Score of 1 Jaida, 3rd Grade Math
Finally, you will observe Jaida’s work on a 3rd grade Math task. This is also a task presented before.
Please do not try to access the videos during the live webinar.

42. Here is p. 1, teacher page

43. The student page for the primary task

44. Here is the p. 3 general prompt teacher page

45. And this is the student’s view of the general prompt
And this is the student’s view of the general prompt. Again in this task you will observe that Jaida’s teacher has made several accommodations for her to address Jaida’s mode of communication in presentation and response.

46. Click → http://www.isbe.net/assessment/iaa.htm
2010 IAA Test
IAA Calendar of Events  
IAA Teacher Trainings: Locations and Dates  
IAA Teacher Training Refresher Webinar: Dates  
IAA Teacher Training PowerPoint (Coming Soon)
IAA FAQs  
IAA 2010 Score Sheet with Accommodations Documentation        
IAA Performance-Based Rubric   (Updated 10/08)
IAA 2010 Implementation Manual  
IAA Sample Scoring Videos  
Level 4
Level 3
Level 2
Level 1
IAA Sample Tasks
2010
2009
At a later time, please go to the website shown at the top of this slide and scroll down to the Level 1 video indicated by the red arrow.
I also call your attention to the many other resources available on this website. In particular, if you or your students would benefit from familiarity with the task format, the sample tasks may be used for practice.
Please be sure to keep track of any questions you may have or type them in as we continue the training.

47. Online Scoring Tool www.iaapearson.com
Now I will hand over the rest of the presentation to Chad Curtis with Pearson.

48. RCDTS Codes Home School 41-057-0110-26-0000 ALTON CUSD 11
Gilson Brown Elementary School
Testing School
WOOD RIVER-HARTFORD ESD 15
Lewis-Clark Elementary School

49. SchoolSuccess – Two Types of Access
Coordinators will have access to the administrative interface to create teacher accounts and assign students to teacher classrooms. Coordinators will also be able to run various reports to monitor the score entry progress of their teachers.
Teachers will have access to a teacher interface where they can enter scores for student’s assigned to their classrooms.

52. 2 1 3 4
1. Click on the + symbol next to the district name, to display all active schools.
2. Select the school where you will be creating a teacher from the list.
3. Select the “Create Teacher” tab.
4. Enter the required information and click “Add”.

53. 1 2 3 4
1. Click the + symbol next to the school name where you are creating a classroom.
2. Click the + symbol next to the Teachers folder, and select a teacher from the list.
3. Select the “Create Classroom” tab.
4. Enter the required information and click “Create”.

54. 3 4 1 2 5 6 1. Click on the + symbol next to the Students folder.
2. Select “Active”.
3. Select the students that are being assigned to a classroom.
4. Click the Transfer button.
5. Select the school* and classroom you are assigning the student to.
6. Click “Continue”. 3 4 1 2 5 6

55. 1. Click the + symbol next to the school name where you are creating a student.
2. Click the + symbol next to the Students folder, and select “Active” from the list.
3. Click the + symbol next to “Create New Student”.
4. Enter the required information and click “Add”. 1 2 3 4

59. Materials Management

60. What are you going to receive?
When will you get it?
Where will it be sent?
What you should do with it?
How can you get more if you need it?
How do you return it?

61. Box 1 (Coordinator Box)
Packing List
Memo
Duplicate copies of school checklists
Spring 2010 Coordinator Kit
(1) IAA Implementation Manual
Red Pearson Return Labels
FedEx Return Labels
Remaining Boxes (1 per testing location)
Packing List
(1) IAA Implementation Manual
Test book Security Checklist
(1) test booklet per student

62. Materials will arrive by February 8th – based on these distribution rules…
Typical Model: materials packaged by testing school and shipped to district
Co-ops: materials packaged by testing school and shipped to co-op central office
CPS: materials packaged by and shipped to school

63. Upon receipt of materials, you should…
Save boxes used to deliver materials for return shipment
Assign books as needed using test book security checklist
If necessary, request additional orders (AO) via Pearson’s online Assessment Network (

64. Ordering Additional Materials
URL:
Under ORDERS tab select IAA Spring 2010 Additional Orders
Order the same form number you received in your initial distribution
Additional Orders are approved by Pearson and usually shipped the next day

65. Return Test Materials (Teachers)
Gather used and unused test books
Sort test books by grade
Place test books in box (placing the highest grade at bottom followed by remaining grades in descending order).

66. Return Test Materials (Coordinators)
Affix the red return label to each box and sequentially number the boxes (e.g., box 1 of 2)
Fax a copy of your test book security checklist, if you have unreturned books
IAA Coordinators will need to ensure that each box in district shipment has a FedEx return label
FedEx will pick-up materials from the original point of delivery on March 24th beginning at 8am
Contact Pearson for assistance with FedEx

67. Additional Resources

68. Useful links available via ISBE website www.isbe.net/assessment/iaa:
Additional Resources
Useful links available via ISBE website
IAA Implementation Manual
Home School RCDTS codes
Frameworks for IAA Reading, Mathematics, Science, and Writing
IAA Scoring Rubric
IAA Online Scoring User’s Guide
Sample Tasks and Videos
Regional Training Presentation

69. Contact Information
For IAA policy and test administration questions:
Pearl Schneider – IAA Coordinator (ISBE)
Jessica Dare – IAA Special Education Consultant (ISBE)
(217) – Office
(866) – Toll-free
For Material Ordering, Distribution and Online Scoring questions:
Pearson Customer Support Center
(888)
Operators available Monday – Friday, 6:00 AM to 7:00 PM CST

70. Questions?