Iowa Assessment Update School Administrators of Iowa November 2013 Catherine Welch Iowa Testing Programs

ReportingEmpirically validated StandardizationResearch based Past -- Emphasis

Guided by mandate to be linked to previous forms for accountability reporting (A, B, E, F) Guided by desire to inform instruction  Emphasis on level of information in reporting structure  Emphasis on reliable reporting Guided by the quality of the information provided to users  Emphasis on measuring growth  Emphasis on college and career readiness Present – Forms E and F

Forms E and F – Test Similarities Balance of Concepts, Applications and Procedures Range of Cognitive Demands Aligned to Common Core Domains Connects Practice to Content

Forms E and F – Technical Similarities Vertical Scale to Measure Growth Allows Direct Comparisons to Previous Forms Parallel Forms allow the Tracking of Students Addresses NCLB Requirements Valid, Reliable and Technically Sound

Form F -- Enhancements Alignment Domain coverage at the same level Expanded standards covered Format Paired Passages Additional informational texts Rigor Using evidence from texts in social studies and science Assessing research and inquiry across all areas

Current Results State Performance Growth Use of Information

Reading Results –

Mathematics Results –

Compared to Nation

Growth in Reading Year Year Growth Expected Growth 3 rd to 4 th th to 5 th th to 6 th th to 7 th th to 8 th th to 9 th th to 10 th th to 11 th

Growth in Mathematics Year Year Growth Expected Growth 3 rd to 4 th th to 5 th th to 6 th th to 7 th th to 8 th th to 9 th th to 10 th th to 11 th

Relationship between STEM Interest and Achievement

Future

Next Generation Iowa Assessment Test ComponentDescription Design and Development Aligned to Iowa Core Variety of item types (essay, constructed-response, technology-enhanced, multiple-choice) Developed by Iowa educators Field tested on Iowa students Delivery Online and Paper/pencil Comparable scores between modes Scoring and Reporting Online reporting system Automated scoring engine where applicable Human scoring where applicable Additional Components Customizable to state of Iowa needs Growth measures College and career readiness indicators Comparable scores over time

Timeline for Next Generation Iowa Assessment School Year Design and Development Delivery Scoring and Reporting Related Research Item design Item writing Field testing Comparability research Online reporting development Growth research Technology- enhanced platform Online pilot Online growth reporting Career and college-ready research Online option available for Iowa Assessments Online reporting available Validity studies Linking Scaling Online option available for Iowa Assessments Online reporting available Psychometric studies New assessment implementation

Information Provided ELAMathOther Iowa Assessment Claim scores Domain scores Proficiency levels National comparisons Growth indicators College readiness Claim scores Domain scores Proficiency levels National comparisons Growth indicators College readiness Social Studies Science Skills Smarter Balanced Assessment Consortium Claim scores Proficiency levels Comparison to SBAC states Claim scores Proficiency levels Comparison to SBAC states NA

Considerations for Moving Forward

Evaluate Purpose of Assessments Evaluate Products to Match Purpose Make Appropriate Comparisons Define Criteria for Evaluation from House File 215 – aligned with the Iowa common core standards in both content and rigor; – accurately describes student achievement and growth for purposes of the school, the school district, and state accountability systems; and – provides valid, reliable, and fair measures of student progress toward college or career readiness

Evaluate Purpose Accountability – Administrator – Teacher – Student Summative Formative Interim

Evaluate Products and Reports to Match Purpose Review the items and tests Review the score reports If adaptive, review the algorithms for adaptive testing – For example, understand how high-level 4 rd graders will be tested and the implications for alignment – Understand how low-level 8 th graders will be tested and the implications for comparisons across students If fixed form, review the implications for the balance and selection of content Compare level of reporting to requirements

Make Appropriate Comparisons

Define Criteria for Evaluation Aligned Reliable Valid Growth Readiness Technology Costs How much is enough? Who are the experts to evaluate these criteria? What are the compromises to be made? How are these compromises tied to purpose?

National Average 201 State Average 204 State Proficiency 189 College Readiness 218 Range of District Averages (342 Districts) Range of Individual Students (35,000 Students) 4 th Grade Mathematics Performance

5 th Grade Mathematics Performance National Average 214 State Average 218 State Proficiency 200 College Readiness 236 Range of District Averages (342 Districts) Range of Individual Students (35,000 Students)

Alignment

Alignment? “Aligned” by 15 trained experts “Aligned” to 11 different standards “Aligned” to 4 different grade levels “Aligned” to 3 different domains

SBAC Alignment?

Alignment? “Aligned” by 7 trained experts “Aligned” to 6 different standards “Aligned” to 3 different grade levels “Aligned” to 3 different domains

Define Criteria for Use What are the metrics to be reported? Are they understood by parents? Will teachers have enough information from the results to shape their instruction? Will teachers receive the responses from the open-ended, constructed-response items? Will teachers receive professional development on the usefulness of the results?

Define Criteria for Technology Identify the vendor that will deliver the assessment Pilot test the types of items to be used Pilot test in a variety of districts in the spring of the year during the same 12-week window; during the busiest times of the day Pilot test using the vendor-developed online tools Pilot test using the graphics, videos, that will be a part of the assessment

Define Criteria for Administration Demand same time-of-year testing Demand reports/information prior to the end of the year Demand reports that show growth, readiness, achievement indicators and instructional- relevance