MI-Access Fall 2010 Webcast September 15, 2010

Welcome and Introductions Dan Evans Assessment Administration and Reporting Office of Educational Assessment & Accountability

Dan Evans – OEAA Linda Howley – OEAA Our Presenters are… Assessment Analyst for Students with Disabilities Linda Howley – OEAA Assessment Consultant for Students with Disabilities

Our Presenters are… Tina Foote – OEAA OEAA Secure Site Coordinator Alison Place – Questar Assessment, Inc. MI-Access Project Manager

Submitting Questions Fax: 734-334-1857 Email: answers@resa.net View any time at: www.MIstreamnet.com

Webcast Agenda The MI-Access “Top 10” MI-Access Assessment Basics What’s New This Year? Participation and Supported Independence (P/SI) Functional Independence Do Not Read Aloud Items Assessment Accommodations

Webcast Agenda OEAA Secure Site Processes Receiving and Returning Assessment Materials Fees Common Administration Errors Communication and Resources

MI-Access Top 10 List Fill in answer bubbles completely with a #2 pencil FI students do not fill in their own bubbles Tested Roster is IMPORTANT Verify information in the Educational Entity Master (EEM) Security Compliance Form stays in district

MI-Access Top 10 List Review the “Students NOT TESTED” screen Inventory Materials when received Apply Pre-ID Labels to Answer Documents Know Your Accommodations READ the MANUAL!

MI-Access Assessment Basics

Fall Assessment Window Grades 3-8 October 11 - November 19, 2010

Who’s Being Assessed? Populations assessed: Participation Supported Independence Functional Independence

What’s Being Assessed? Content areas assessed for each population: English Language Arts P/SI (Grades 3-8) FI Accessing Print (Grades 3-8) FI Expressing Ideas (Grades 4&7) Mathematics (Grades 3-8) Science (Grades 5 and 8) Since MI-Access does not assess Social Studies, the IEP team must decide the appropriate level test.

Key Dates Arrival of Materials: Week of Sept. 27 Additional Orders: October 4 - November 16 Return Materials: NO LATER THAN DEC. 3

What’s New This Year? Student Demographic data entry to MSDS No Released Items Class/Group ID Sheets School Header Sheets School Return Envelope Test Administrator Manual Missing UIC will invalidate scores

What’s New This Year? Materials Return Kit New “State Model” IEP form MI-Access Material Return Labels Braille orders at state level only MEAP-Access Eligibility Bubble Field testing of new item formats in some forms Item Descriptor Booklet posted for FI

Participation and Supported Independence (P/SI)

P/SI Student Populations Content Areas Assessment Booklets Item Formats Scoring Rubrics

Participation Students who have, or function as if they have, severe cognitive impairment

Participation Expected to require extensive ongoing support in adulthood and may have significant cognitive and/or physical impairments that limit their ability to generalize or transfer learning Dependent on others for most, if not all, daily living needs

Participation The instructional approach for these students targets opportunities for them to integrate into age-appropriate tasks, activities related to daily living skills, and academic content

Supported Independence Students who have, or function as if they have, moderate cognitive impairment

Supported Independence Will require ongoing support in major life roles and may have cognitive and/or physical impairments that limit their ability to generalize or transfer learning

Supported Independence Instructional approach is direct, in context, and targeted toward specific, essential independent living and academic skills

Supported Independence Working toward mastering daily living and employment routines and an acceptable level of independent living

P/SI Content Areas Assessed English Language Arts, Mathematics, Science MI-Access EGLCEs/EBs/ (Grades 3-8) See Slide 8 – possible duplication

P/SI Assessment Booklets Combined booklets for ELA, mathematics and science Participation is right side-up Supported Independence is upside down Color coordinated

Participation ELA and Mathematics = Blue

Participation Science = Pink

Supported Independence ELA and Mathematics = Green

Supported Independence Science = Red

Item Development All items aligned to EGLCE/EB coded to adult life contexts

Item Development Core items count toward the student’s score Embedded items are for field testing ONLY

Item Types and Formats Selected Response/Multiple Choice SI: 3 choices-graphics P: 2 choices-graphics

Item Types and Formats Observation/Activity Many items use an activity-based observation format Paper and pencil tests aren’t appropriate

Selected-response ELA, mathematics, and science have selected-response items ALL selected-response items administered the same way

Selected-response Selected-response picture cards will be provided by the MI-Access contractor

Selected-response ONE set of picture cards will be shipped to each TEACHER based on: content area (P/SI ELA and Mathematics OR P/SI Science) grades being assessed

Picture Cards Picture cards are presented in very specific ways Read manual sections on the different presentation styles Watch presentation styles in online learning program

Selected-response Two reasons for picture cards: Not practical for students to look at pictures in an assessment booklet. Selected-response items have to be presented twice – each time in a different order.

Sample SI Item Which of these shows a pulley being used? A hammer and nail B raising a flag Please note that this is just a sample created to give participants an idea of the format for these items. This particular item has not been through the editorial and review processes that all of the other items went through. C wheelchair on ramp

Picture Cards The assessment administrator will be provided with 8½ X 11 pictures of a hammer and nail, raising a flag, and a wheelchair on ramp.

Sample Participation Item Which one can go faster? A B

Picture Cards The assessment administrator will be provided with 8½ X 11 pictures of a car and a bicycle.

Picture Cards

MI-Access Artwork Artwork is available at the MI-Access Web page for review and instructional use This one looks out of place

Activity-Based Observation Assessment administrators need to use whatever they typically use during instruction in the format most familiar to the student

Activity-Based Observation Assessment administrators will provide THEIR OWN picture cards IF they are typically used during the activity or routine where the item is being administered

Sample Participation Item Activity: The student will respond appropriately to a greeting from an unfamiliar person, such as a teacher, support staff, or related service provider, during arrival or dismissal time. Scoring Focus: Responding to and/or communicating with a variety of audiences

Participation Scoring Rubric Score Point Definition 3 Responds correctly with no assessment administrator assistance 2 Responds correctly after assessment administrator provides verbal/physical cues 1 Responds correctly after assessment administrator provides modeling, short of hand-over-hand assistance Condition Codes - All condition codes result in no points. A Incorrect response B Resists/refuses C Assessment administrator provides hand-over-hand assistance and/or step-by-step directions

SI Scoring Rubric Score Point Definition 2 Responds correctly with no assessment administrator assistance 1 Responds correctly after assessment administrator provides verbal/physical cues Condition Codes - All condition codes result in no points. A Incorrect response B Resists/refuses C Assessment administrator provides hand-over-hand assistance and/or step-by-step directions

Online Learning MI-Access P/SI Scoring Rubrics Online Learning Program is available on the Web page at www.mi.gov/mi-access

Functional Independence

Functional Independence Student Population Content Areas Assessment Booklets Item Format Expressing Ideas Scoring Rubric Administering Assessment

Functional Independence For those students who have, or function as if they have, a mild cognitive impairment

Functional Independence Can typically assess their personal strengths and limitations Can access resources, strategies, and supports to help them maximize their independence

Functional Independence Content Areas Accessing Print Expressing Ideas Mathematics Science

FI Accessing Print - Purple Grades 3, 5, 6, 8 Word Recognition Text Comprehension

FI Accessing Print and Expressing Ideas - Purple Grades 4&7 Word Recognition Text Comprehension Expressing Ideas

FI Math Assessments - Gold Grades 3-8 Data and Probability Geometry Measurement Numbers and Operations Algebra

Sample FI Math item

FI Science Assessments - Orange Grades 5&8 Constructing New Scientific Knowledge Reflecting on Scientific Knowledge Using Life Science Knowledge Using Earth Science Knowledge Using Physical Science Knowledge

Sample FI Science item

Functional Independence Resemble paper/pencil test Use multiple-choice item format ONLY, except for Expressing Ideas

Functional Independence Students DO NOT complete answer document; assessment administrators transfer student responses from test booklet to the answer document

Administering FI Assessment Read the manual before administration Scripts in the manual for each content area that MUST be followed during assessment administration

Administering FI Assessment Become familiar with scripts ahead of time Need to fill in assessment booklet page numbers in the script

Functional Independence Text comprehension passages are designed to be appropriate for age/interest levels of students being assessed Most students should be able to read passages

Functional Independence If a student accesses print through a reader, it is considered a standard accommodation

Administering FI Assessment Decide on a student-by-student basis if assessments will be administered individually or in a group

Administering FI Assessment There is NO time limit – use own judgment on time allowed and how much to administer in one sitting

Optional Test Materials Mathematics: coins, bills, clocks, calendars, meters, etc. Science: sand, water, flashlight, musical instruments, etc.

Do Not Read Aloud Items

Do Not Read Aloud Items “Do NOT Read Aloud” table included in front of EVERY assessment booklet Use table to mark booklets

Sample “Do Not Read Aloud” Table

Do Not Read Aloud Items Word Recognition - answer choices Pictures/graphics not accompanied by words or labels

Do Not Read Aloud Items Mathematics items include: Money items – where coins or bill can’t be named Base 10 block items – can’t read keys and answer choices

Do Not Read Aloud Item Science Some picture answer choices can’t be named because it would give answer away

Do Not Read Aloud Item Review Appendix B in manual describing types of items that shouldn’t be read aloud

Assessment Accommodations Linda Howley Assessment Consultant for Students with Disabilities Office of Educational Assessment & Accountability

Assessment Accommodation Summary Table Revised Accommodations Summary Table (Fall 2009) Displays accommodations for MEAP, MEAP-Access, MI-Access, ELPA, and NAEP Revised table located at www.mi.gov/mi-access

Assessment Accommodation Summary Table Accommodation Types Standard (S) Does not change the construct of what’s being measured

Assessment Accommodation Summary Table Accommodation Types Universal Any student can utilize, regardless of eligibility, without changing what is being measured by the assessment

Assessment Accommodation Summary Table Accommodation Types Non-standard (NS) Changes construct of test Does NOT count toward Valid assessment scores School accountability Must be communicated to parents and students

Assessment Accommodations Summary Table

Assessment Accommodations IEP Team Decision Making The IEP Team has two responsibilities by law: Choose which state assessment Choose accommodations (if any)

Assessment Accommodations IEP Team Decision Making Assessment Continuum Assessment Type of Assessment Based On MEAP General GLCEs MEAP with Accommodations MEAP-Access (not available 2010) AA-MAS Functional Independence AA-AAS Extended GLCEs Supported Independence Participation

Assessment Accommodations IEP Team Decision Making Decide which content areas are to be assessed Determine if the student is in one of the tested grades Remember, same grade as reported enrolled in MSDS

Assessment Accommodations IEP Team Decision Making Content Area 3 4 5 6 7 8 9 Reading X Writing Math Science Social Studies

Assessment Accommodations IEP Team Decision Making When determining the appropriate state assessment Never choose based on disability category alone Never choose based on one piece of data Must consider curriculum and instruction

Assessment Accommodations IEP Team Decision Making IEP Team has the flexibility to have a student participate in MEAP and MI- Access Functional Independence in different content areas. MI-Access Supported Independence and Participation students are not included in this option

Assessment Accommodations IEP Team Decision Making Determine level of independence per content area Full Independence Functional Independence Supported Independence Participation Based on cognitive functioning level.

Assessment Accommodation IEP Team Decision Making The IEP team may designate ANY accommodation it deems necessary. Student needs Routinely used in instruction Must be documented in IEP Decision must be made for each content area

Assessment Accommodations IEP Team Decision Making Decision Making Worksheet What content standards? What does instruction look like? Level of independence? Assessment? Accommodations?

Accommodated Formats (FI) Braille, Audio CDs, and Enlarged Print Kits were developed from Form 1 test booklets. Answer documents are included in kits.

Accommodated Formats Braille Kit includes Braille Form-9 test booklet Assessment Administrator Booklet for Braille (AABB) Braille ruler, if applicable Answer document

Accommodated Formats Braille version Print-to-Braille correspondence available at www.mi.gov/mi-access Student answers must be transferred onto scannable answer document

Accommodated Formats Braille version Braille material can only be ordered by telephone at 877-560-8378 option 4

Accommodated Formats Enlarged Print Kit includes Enlarged print test booklet Enlarged print is approximately 15-point font size Regular print Form 1 test booklet Enlarged print ruler (if applicable) Answer document

Accommodated Formats Audio CD kit includes CD Form 1 test booklet Answer document Ruler (if applicable)

Accommodated Formats Audio CD version Administered individually, or in small groups when each student has a headset and control over the CD player CD track listings posted to www.mi.gov/mi-access

Common Accommodations Scribe Make sure it is transcribed exactly how student dictates onto student answer document Scribe must initial and date answer document Fill in Scribe bubble on answer document

Common Accommodations Word Processing of Expressing Ideas response Each page must be labeled Insert word-processed response into student’s answer document Follow special handling instructions in TAM

Assessment Accommodations Resources OSE-EIS New State Model IEP Material Draft Guidelines for Participation in State Assessment for Students with Disabilities Participation Worksheet Assessment Plans

Assessment Accommodations Resources GLCEs, EGLCEs, EBs Sample assessment booklets Released items Online Learning Program

Assessment Accommodations Resources Web resources www.mi.gov/oeaa www.mi.gov/mi-access www.mi.gov/ose-eis OEAA – Office of Educational Assessment and Accountability OSE-EIS – Office of Special Education and Early Intervention Services OSI – Office of School Improvement

OEAA Secure Site Tina Foote Secure Site Coordinator Office of Educational Assessment & Accountability

OEAA Secure Site Address www.michigan.gov/oeaa-secure

OEAA Secure Site Announcement page Contains important messages in relation to the OEAA Secure Site Contains important deadlines and dates regarding the OEAA Secure Site Contains information for all assessments

OEAA Secure Site Additional Material Orders Always check with district coordinator Only district level user can order

OEAA Secure Site Additional Material Orders Click on Add’l Material Orders from the left Select shipping destination Braille Orders – state user only

OEAA Secure Site Additional Material Orders

OEAA Secure Site Order Summary/Tracking Click on “Order Summary/Tracking” from the left. Report button creates a printable report of all orders displayed.

OEAA Secure Site Order Summary/Tracking Available to track your order and shipment: Order Detail for each order Current status of ordered Date shipped Tracking number with link to track the package(s) through the shipping vendor i.e. UPS

OEAA Secure Site Barcode Labels All answer documents must have a barcode label Home school students Students must be identified for testing Click on Barcode Label from the menu at the left

OEAA Secure Site Barcode Labels

OEAA Secure Site Barcode Labels

OEAA Secure Site Barcode Labels All answer documents must have a barcode label Print with a laser printer, not inkjet

OEAA Secure Site Barcode Labels Specific to student, school and test cycle Cannot use previous years Cannot use from other test cycles, i.e. MEAP Reprint damaged labels Ensure barcode label matches student’s name at top

OEAA Secure Site Tested Roster Very important!! Last chance to identify errors and report them Did I mention this is very important!!

OEAA Secure Site Tested Roster Verify all answer documents received Verify no duplicate records Verify students are listed in building where they tested Verify student demographics How do you change them?

OEAA Secure Site Tested Roster Out-of-Level Prohibitive Behavior Non-Standard Accommodation Special Education Reports and AYP file created from this data

OEAA Secure Site Tested Roster

OEAA Secure Site Not Tested Start getting prepared now Select reason student did not test Needed for federal reporting and AYP

OEAA Secure Site Report Printing Options Selected at a district level Two options: All reports Green – individual student report, student record labels and parent reports Defaults to Green option

OEAA Secure Site Report Printing Options

OEAA Secure Site OEAA Secure Site User Manual Located on log in page Located at bottom of Announcement page after logging in Contact us at oeaa@michigan.gov Contact us at 877-560-8378 and press option 4 for MI-Access

Receiving Your Assessment Materials From Questar Assessment, Inc. Alison Place MI-Access Project Manager Questar Assessment, Inc.

WHAT’S NEW FOR FALL 2010 The District, Teacher and School ID sheets are replaced with a Class/Group ID Sheet and a School Header Sheet. The Teacher Return Envelope is replaced with a School Return Envelope. Paper strips will no longer be necessary to bundle envelopes, and will not be provided.

WHAT’S NEW FOR FALL 2010 (Cont’d) The formerly named “Coordinator and Assessment Administrator Manual” is now the “2010/2011 Test Administrator Manual.” The Return of Materials Packet has been replaced with a Materials Return Kit.

WHAT’S NEW FOR FALL 2010 (Cont’d) In addition to the UPS/RS labels, districts will also be provided with additional labels to adhere to their packages when returning materials to the contractor. These labels are called MI-Access Material Return Labels and are being provided to assist the contractor in identifying and processing packages. These labels will be included in the Materials Return Kit along with accompanying instructions.

Arrival of Materials One shipment of materials, including assessment booklets, scan documents, and pre-ID labels. Materials to arrive in districts week of September 27 (two weeks before testing). Be sure materials are inventoried by school coordinators and any packing list discrepancies reported to 877-560-8378 option 4.

Shipment Packaging Materials will be shipped to districts, but will be packaged by school. Each school box will be shipped separately and will have its own tracking information. Please check the OEAA Secure Site for details about the number of boxes your district will receive.

Shipment Contents The district and school boxes will contain all materials needed to administer the assessments, including: Standard print booklets Accommodated versions Student answer documents Preprinted pre-ID barcode labels

Shipment Contents Note: Preprinted student barcode labels will be provided to districts that pre- identified their students by September 16, 2010. Districts must continue to pre-ID their students after this date and print labels locally.

Shipment Contents District boxes will contain: Cover Letter District packing slip Copies of school packing slips Security Compliance Forms

Shipment Contents District boxes will contain: Materials Return Kit that includes: UPS/RS labels, MI-Access Material Return Label, packing checklist, and divider sheets.

Cover Letter Explains materials enclosed in each shipment

District and School Packing Slips Use to inventory materials

Shipment Contents School boxes will contain: School Packing Slip Standard print forms Accommodated versions Student answer documents P/SI picture cards Rulers

Shipment Contents School boxes will contain: Preprinted Pre-ID barcode labels* Class/Group ID Sheets School Header Sheet School Return Envelope Security Compliance Forms *For students pre-identified in the OEAA Secure Site by September 16, 2010.

Shipment Contents IMPORTANT!! School Coordinators should inventory materials using the school packing slip.

Shipment Contents An overage of most materials has been included in the school box, which should reduce the need for additional materials. Contact the District Coordinator if any materials are missing and/or if additional materials are required.

Security Compliance Forms Security Compliance Forms (SCF) are to be: Completed by all coordinators, primary and shadow administrators Kept on file for one year by the MI- Access District Coordinator

Returning Materials After Testing

No Missing Pre-ID Barcode Labels, Please! All student answer documents returned for scanning and scoring must have pre- ID barcode labels. Fees will be assessed for answer documents with missing barcode labels…More about this later.

Ship no later than December 3, 2010. Return of Materials to Questar Ship no later than December 3, 2010.

Don’t Be Late! Please be sure to ship materials by December 3 to ensure your students’ answer documents are processed and scored. Districts will be assessed financial and other penalties for late materials.

Return of Materials to Questar Ensure scorable answer documents are placed in the School Return Envelope with a School Header sheet. School assessment materials should be organized and packaged in the box in which they were received. Ensure School Return Envelopes are shipped with School Header sheet.

Return of Materials to Questar School materials must be sent to the District Coordinator (see manual for details). They SHOULD NOT BE SENT directly to Questar. The District Coordinator will ship all district materials to Questar.

Return of Materials to Questar There will be one UPS/RS label per school box. However, districts may place school boxes in a larger box so they are shipped together, if desired. Use the Material Return Labels (tan) to mark the boxes for returning.

Fees 2010-2011 Dan Evans Assessment Analyst for Students with Disabilities Office of Educational Assessment & Accountability

Fees for 2010-2011 Student answer documents returned without a Pre-ID label will have a label affixed by the contractor at a cost of $10 per document. If a label cannot be affixed by the contractor, the document will not be scored.

Fee Schedule

The Most Common Administration Errors

Most Common Administration Errors Answer documents returned without barcode labels Answer documents returned with incorrect barcode labels (name on answer document does not match label)

Most Common Administration Errors Answer document does not have form number bubbled in and/or written in Students taking multiple assessment types (P/SI and FI)

Most Common Administration Errors Students taking out-of-level assessments (test form grade does not match pre-ID grade) Student answer documents returned under wrong School Header sheets

Most Common Administration Errors Administering accommodated version of Functional Independence assessments when NOT documented in the student’s IEP and/or used in daily instruction Answer documents not completed correctly

Most Common Administration Errors Answer documents completed by students rather than by assessment administrators Bubbles not filled in with #2 pencil correctly (must be dark enough and fill in circle completely)

Most Common Administration Errors PAA and SAA scores not recorded for each student for each item for P/SI assessments Orders for AMO/Initial Material Orders not entered by appropriate district level personnel

Most Common Administration Errors Orders for AMO/Initial Material Orders not entered under appropriate schools Tested Roster not being reviewed by many districts

Misadministration Process Any misadministration of the assessments may be self-reported by going to the OEAA secure site and selecting the document at the lower section of the announcement page titled: “OEAA Test Administration Incident Report”

IMPORTANT COMMUNICATIONS OEAA sends important emails to District MI-Access Coordinators throughout the administration cycle. Ensure your contact information, particularly email address, is updated and accurate in EEM (Educational Entity Master).

IMPORTANT COMMUNICATIONS Ensure your district’s IT professional confirms you can receive these emails and attachments.

Questions Linda Howley Assessment Consultant for Students with Disabilities Office of Educational Assessment & Accountability

MI-Access Top 10 List Fill in answer bubbles completely with a #2 pencil FI students do not fill in their own bubbles Tested Roster is IMPORTANT Verify information in the Educational Entity Master (EEM) Security Compliance Form stays in district

MI-Access Top 10 List Review the “Students NOT TESTED” screen Inventory Materials when received Apply Pre-ID Labels to Answer Documents Know Your Accommodations READ the MANUAL!

Contact Information Call 1-877-560-8378 option 4 oeaa@michigan.gov.

Thank You! FAQ Archived Event VHS or DVD copy Brenda Hose at 734-334-1437 or hoseb@resa.net