Slide 1 National Center on Educational Outcomes (NCEO) Snapshots: What We Know about State Assessment Practices Martha L. Thurlow National Center on Educational.

Slides:

Advertisements

Similar presentations

NCAAAI CHANGES Sheila Garner Brown North Carolina State University

Advertisements

National Accessible Reading Assessment Projects Defining Reading Proficiency for Accessible Large Scale Assessments Principles and Issues Paper American.

Partnership for Accessible Reading Assessment Analysis of Current Characteristics of State Reading Assessments Christopher Johnstone National Center on.

PUBLIC SCHOOLS OF NORTH CAROLINA STATE BOARD OF EDUCATION DEPARTMENT OF PUBLIC INSTRUCTION North Carolina Alternate Assessment Program Overview of Alternate.

GAP Kids or Gray-area Kids ? Defining who they are under No Child Left Behind (NCLB)? Why this group of students exists? What are the consequences of being.

2015 SpEd Assessment Updates TETN Event # Presented June 5, 2013 TEA’s Student Assessment Division.

Determining Validity For Oklahoma’s Educational Accountability System Prepared for the American Educational Research Association (AERA) Oklahoma State.

Oregon’s Alternate Assessment: Past, Present, and Future Tense Oregon Department of Education Dianna Carrizales, PhD Office of Student Learning and Partnerships.

Digging Into the Data to Learn More About Low Performing Student with Disabilities Sheryl Lazarus Successfully Transitioning Away from the 2% Assessment.

WELCOME AND INTRODUCTIONS The presenters are: Erika Bolig – OSA Professional Development Coordinator Linda Howley – OSA Assessment Consultant for Students.

N C E O National Center on Educational Outcomes State Variations in Accommodations Policy and Practice Martha L. Thurlow University of Minnesota.

National Center on Educational Outcomes (NCEO) Overview of Existing Alternate Assessments Based on Modified Academic Achievement Standards (AA-MAS) Sheryl.

Prevalence of Out-of-Level Testing Martha Thurlow and Jane Minnema National Center on Educational Outcomes

National Center on Educational Outcomes June, 2004 How do we keep kids from being stuck in our gap? A frame, a series of discussion questions, and some.

N C E O National Center on Educational Outcomes Accommodation Decisions: Policy, Training, and Monitoring as Critical Aspects of an Objective Approach.

N C E O National Center on Educational Outcomes Designing and Using Assessment and AYP Reports for Improved Achievement at State and Local Levels Martha.

NCEO Indicator 3 Tool To be used for lifting assessment data from Section 618: Table 6 reports Altman, J. R., Bremer, C., Vang, M., Thurlow, M., & Rogers,

National Center on Educational Outcomes What Item Level Data Tell Us About Universal Design: Fantasy, Foolishness, or Fuel for Fire? in Large- Scale Assessments.

NCEO Assessing Educational Results: Tough Issues for Students with Learning Disabilities Martha L. Thurlow NCEO University of Minnesota Facing Tougher.

Jason Altman – NCEO Mari Quenemoen – NAAC TASH Annual Conference – Nov. 19,

Meeting NCLB Act: Students with Disabilities Who Are Caught in the Gap Martha Thurlow Ross Moen Jane Minnema National Center on Educational Outcomes

Office of Special Education Programs, Research to Practice Division Welcome Project Directors.

N C E O National Center on Educational Outcomes Accommodation Policies and Score Comparability Issues Martha L. Thurlow University of Minnesota.

Minnesota Manual of Accommodations for Students with Disabilities Training Guide

N C E O National Center on Educational Outcomes 2003 State Special Education Outcomes: Marching On Results of NCEO’s Survey of State Directors of Special.

National Center on Educational Outcomes (NCEO) Modified Academic Achievement Standards (AA-MAS) Martha Thurlow National Center on Educational Outcomes.

The Characteristics of Non-Proficient Special Education and Non-Special Education Students on Large-Scale Assessments Yi-Chen Wu, Kristi Liu, Martha Thurlow,

Diploma Options, Graduation Requirements, and Exit Exams for Youth with Disabilities: Implications for College and Career Readiness David R. Johnson, Ph.D.

Navigating the State Assessment Program Pam Biggs NCDPI Division of Accountability Services Conference on Exceptional Children November 7, 2006.

2% Modified Achievement Assessments Overview (C-5) Ohio Department of Education Office of Assessment September

Groton Elementary Agenda: Discuss assessments, modifications, and accommodations Review common accommodations for assessments Study of Test.

Martha Thurlow and Laurene Christensen National Center on Educational Outcomes CEC Preconvention Workshop #4 April 21, 2010.

National Center on Educational Outcomes Fall, 2004 Alternate assessment, gaps, and other challenges! A view of current practices from the technical assistance.

NCEXTEND2 Assessments Mike Gallagher, NCDPI Nadine McBride, NCDPI Sheila Garner Brown, TOPS.

NCEXTEND Grade 7 Writing

Assessing Students With Disabilities: IDEA and NCLB Working Together.

Assessing Students with Special Needs Alternate Assessments.

A Principled Approach to Accountability Assessments for Students with Disabilities CCSSO National Conference on Student Assessment Detroit, Michigan June.

The 1% Rule: Alternate Assessment Participation November 20, 2007.

Technology Assisted Reading Assessment Cara Cahalan Laitusis Educational Testing Service Martha Thurlow NCEO.

1 Alternate Assessments Based on Modified Academic Achievement Standards Fen Chou, Ph.D. Louisiana Department of Education GSEG Project Kick-off Meeting.

Michigan Educational Assessment Program MEAP. Fall Purpose The Michigan Educational Assessment Program (MEAP) is Michigan’s general assessment.

Fall 2010 Mathematics Standards of Learning Assessment Update - 1 -

Emily Day.  The state of North Carolina requires that all students be assessed at the end of the school year (middle and high school) or at the end of.

Slide 1 National Center on Educational Outcomes (NCEO) Incorporating Universal Design Principles in Next Generation Assessment Item Design Sheryl Lazarus.

How Do Students with Disabilities Participate in the Standardized Testing and Reporting (STAR) Program? September 28, 2011.

How a Theoretical and Data-based Modification Process Can Help Students Eligible for an AA-MAS The Consortium for Alternate Assessment Validity and Experimental.

1 National Center on Educational Outcomes What’s so Difficult About Including Special Education Teachers and Their Students in Growth Models Used to Evaluate.

State Efforts to Improve Instruction and Assessment of Students who May be Candidates to Take the Alternate Assessment Based on Modified Academic Achievement.

Test Accommodations Students with Disabilities 2012 Presented by Janice Koblick, Curriculum Supervisor Exceptional Student Education 1.

Who are the Students in Alternate and Modified Achievement Standards Assessments? Jacqueline F. Kearns, Ed.D., NAAC Martha Thurlow, Ph.D., NCEO Elizabeth.

Slide 1 National Center on Educational Outcomes (NCEO) States’ Data-Based Responses to Low Achieving Students on State Assessments Martha L. Thurlow National.

Minnesota Manual of Accommodations for Students with Disabilities Training January 2010.

1 NCEXTEND1 Alternate Assessment with Alternate Achievement Standards Conference on Exceptional Children November 17-18, 2008 NCDPI Division of Accountability.

No Child Left Behind Impact on Gwinnett County Public Schools’ Students and Schools.

Including analysis and self-help tools for coordination with Section 618: Table 6.

NCEXTEND1 Elementary Science What Does it Look Like? Something like this... NCEXTEND Student Test BOOKLET Picture/Symbol Text Cards.

How was LAA 2 developed?  Committee of Louisiana educators (general ed and special ed) Two meetings (July and August 2005) Facilitated by contractor.

1 National Center on Educational Outcomes (NCEO) Martha L. Thurlow Accommodations for Students with Disabilities Decision Making Considerations for Validity.

Breakout Discussion: Every Student Succeeds Act - Scott Norton Council of Chief State School Officers.

Closing the Educational Gap for Students with Disabilities Kristina Makousky.

State Graduation Policies for Students with Disabilities

Martha Thurlow, Phd Linda Goldstone, MS APRIL 22, 2017

State-Defined Alternate Diplomas

American Institutes for Research

What States are Doing That Meet the 1% Cap

Federal Policy & Statewide Assessments for Students with Disabilities

What Do the Part B 618 Table 6 Data Tell Us?

Solving the Riddle That Is APR Indicator 3

Assessing Students With Disabilities: IDEA and NCLB Working Together

Presentation transcript:

Slide 1 National Center on Educational Outcomes (NCEO) Snapshots: What We Know about State Assessment Practices Martha L. Thurlow National Center on Educational Outcomes

Slide 2 Assessment Options General Assessments General Assessments with Accommodations Alternate Assessments based on Grade- Level Achievement Standards Alternate Assessments based on Alternate Achievement Standards Alternate Assessments based on Modified Achievement Standards National Center on Educational Outcomes (NCEO)

Slide 3 General Assessments Participation Performance Assessment Development Narrowing the Achievement Gap National Center on Educational Outcomes (NCEO)

Slide 4 Participation Public reporting of participation provides one view – most often NCLB view (students count only if in school for one year) Reporting to the Secretary of Education, as required by law gives another view – based on total population of students with IEPs National Center on Educational Outcomes (NCEO)

Slide 5 National Center on Educational Outcomes (NCEO) From NCEO analysis of APR data – Thurlow et al., 2008

Slide 6 National Center on Educational Outcomes (NCEO) From NCEO analysis of APR data – Thurlow et al., 2008

Slide 7 Participation Reporting Practices Changing Situations Under Which Students are Counted as Nonparticipants (# of States): Did not take assessment47 35 Did not complete enough items to score176 Accommodations produced invalid results188 Tested at a lower grade than enrollment162 National Center on Educational Outcomes (NCEO) Based on data from the 2007 NCEO Survey of States

Slide 8 Performance Public reporting of performance provides one view – most often NCLB view (students count only if in school for one year) Reporting to the Secretary of Education, as required by law gives another view – based on total population of students with IEPs National Center on Educational Outcomes (NCEO)

Slide 9 National Center on Educational Outcomes (NCEO) md = missing data (2 regular states and 1 unique state From NCEO analysis of APR data – Thurlow et al., 2008

Slide 10 National Center on Educational Outcomes (NCEO) md =missing data (n=1 regular state and 1 unique state From NCEO analysis of APR data – Thurlow et al., 2008

Slide 11 Assessment Development National Center on Educational Outcomes (NCEO) How States Addressed Universal Design in General Assessment Development Process (# of States): Included in RFP for test development39 Expert review27 Think aloud methods as part of field test2 Statistical analyses10 “UDA” NOT addressed in test development 1 Based on data from the 2007 NCEO Survey of States

Slide 12 Assessment Development National Center on Educational Outcomes (NCEO) Bias/Sensitivity Reviews – Representation of Disability Perspective DisabilityNo DisabilityRepresentation Content Review31 3 Bias Review332 Based on data from the 2007 NCEO Survey of States

Slide 13 National Center on Educational Outcomes (NCEO) Narrowing the Achievement Gap National Center on Educational Outcomes (NCEO) Perceived Factors Related to Positive Achievement Based on data from the 2007 NCEO Survey of States

Slide 14 Positive Trends in Performance National Center on Educational Outcomes (NCEO) Data Availability for Positive Trend Factors Based on data from the 2007 NCEO Survey of States

Slide 15 National Center on Educational Outcomes (NCEO) General Assessments with Accommodations Numbers Using Accommodations Accommodations Policies Hints & Tips for States

Slide 16 National Center on Educational Outcomes (NCEO) Accommodations States are required to report on the number of students using accommodations during the general assessment Not all states yet report these data; some report data for different types of accommodations than others

Slide 17 National Center on Educational Outcomes (NCEO) From NCEO analysis of APR data – Thurlow et al., 2008

Slide 18 National Center on Educational Outcomes (NCEO) From NCEO analysis of APR data – Thurlow et al., 2008

Slide 19 Accommodation Policies Change States with Read Aloud Question Changes in Policy – comparing 2003 to 2005 and 2007 National Center on Educational Outcomes (NCEO) Number of States No changes since One change since Two changes since From NCEO Data Viewer at

Slide 20 National Center on Educational Outcomes (NCEO) Alternate Assessments based on Grade-Level Achievement Standards (AA-GLAS) Number of States Providing This Option Issue – A Misunderstood Option?

Slide 21 National Center on Educational Outcomes (NCEO) ReadingMath ElementaryMiddle High SchoolElementaryMiddle High School Kansas18%21%19%15%22%19% Louisiana5%10%5% 10%5% Massachusetts a 0% a 1% Minnesota8%7%6%7% 8% Mississippi a 0% a 0% North Carolina18%16%2%15% 2% Texas19%20%13%22%21%14% Virginia10%12%0% a 8%11%0% a Wisconsin a 1%0% a 1%0% a Percentage of Students with IEPs Participating in AA-GLAS a Small percentage (< 0.5) participated n the grade level(s) and content area(s) represented as 0%. From NCEO analysis of APR data – Thurlow et al., 2008

Slide 22 Issue: AA-GLAS Misunderstood * KansasIndiana LouisianaMassachusetts MassachusettsMontana MinnesotaNorth Carolina MississippiVirginia North CarolinaWashington TexasWest Virginia Virginia Wisconsin National Center on Educational Outcomes (NCEO)

Slide 23 National Center on Educational Outcomes (NCEO) Alternate Assessments based on Alternate Achievement Standards Participation Performance

Slide 24 National Center on Educational Outcomes (NCEO) From NCEO analysis of APR data – Thurlow et al., 2008

Slide 25 National Center on Educational Outcomes (NCEO) From NCEO analysis of APR data – Thurlow et al., 2008

Slide 26 States Exceeding the 1% Cap Delaware*MichiganOregon** FloridaMississippiTexas GeorgiaNorth DakotaVirginia Louisiana*OhioWisconsin** Massachusetts** National Center on Educational Outcomes (NCEO) * High School Only ** Elementary School Only From NCEO analysis of APR data – Thurlow et al., 2008

Slide 27 National Center on Educational Outcomes (NCEO) Alternate Assessments based on Modified Achievement Standards Number of States Providing This Option Criteria for Participation Nature of Assessments

Slide 28 National Center on Educational Outcomes (NCEO) Number of States with AA-MAS July 2007 – 5 states indicated that they had an AA-MAS (all were developed prior to the April, 2007 regulation: Kansas Louisiana North Carolina North Dakota Oklahoma In addition, Maryland provided information on its Web site about the development a AA-MAS. From NCEO Synthesis Report 67 – Lazarus et al., 2007

Slide 29 States Considering AA-MAS National Center on Educational Outcomes (NCEO) Based on data from the 2007 NCEO Survey of States

Slide 30 Criteria for Participation National Center on Educational Outcomes (NCEO) Criteria No. of States Student has IEP6 Multiple years behind grade level expectations4 Not based on categorical label4 Does not have significant cognitive disabilities4 Not due to excessive absences or to social, cultural, environmental, or economic factors 4 Learning grade level content3 Not based on placement setting2 Previously scored at unsatisfactory level2 Eligibility Criteria in 6 States with AA-MAS* * Includes Maryland From NCEO Synthesis Report 67 – Lazarus et al., 2007

Slide 31 National Center on Educational Outcomes (NCEO) NCEO Survey Showed States Identifying Many Categories As Most Likely to Participate in AA-MAS Based on data from the 2007 NCEO Survey of States

Slide 32 Nature of Assessments National Center on Educational Outcomes (NCEO) StatePortfolioMultiple Choice Constructed Response Writing Prompt KSX LAXXX MDX NCX NDX OKXX Total1512 Type of Assessment/Questions in 6 States with AA-MAS From NCEO Synthesis Report 67 – Lazarus et al., 2007

Slide 33 National Center on Educational Outcomes (NCEO) ChangeNo. of States Distractor Removed4 Fewer Items4 Simplified Language4 Shorter Passages3 Segmentation of Passages1 Nature of Changes to Items in 6 States with AA-MAS From NCEO Synthesis Report 67 – Lazarus et al., 2007

Slide 34 National Center on Educational Outcomes (NCEO) Accommodation No. of States Fewer items/page3 Larger font size3 Calculator2 Breaks as needed2 Key text underlined/bolded1 Accommodations Incorporated into Design in 6 States with AA-MAS From NCEO Synthesis Report 67 – Lazarus et al., 2007

Slide 35 National Center on Educational Outcomes (NCEO) Characteristics of Assessment in 40 Planning to Develop and AA-MAS CharacteristicNumber of States Include only multiple choice questions11 Reduce total # of items or time to complete25 Simplify vocabulary26 Use non-traditional items or formats16 Use shorter or fewer reading passages29 Use fewer items or fewer answer choices23 Based on data from the 2007 NCEO Survey of States

Slide 36 Stay Tuned for More Snapshots National Center on Educational Outcomes (NCEO) Visit NCEO’s Web site for more and continuing information on assessment options: