LD in 2003: Revitalizing, Reauthorizing, and Reconceptualizing our Definitions, Assessment, and Interventions of Learning Delayed Students James McDougal Michael LeBlanc SUNY Oswego

NY Learning Disability Definition A student with a disorder in one or more of the basic psychological processes involved in understanding or in using language, spoken or written, which manifests itself in an imperfect ability to listen, think, speak, read, write, spell, or to do mathematical calculations. The term includes such conditions as perceptual handicaps, brain injury, neurological impairment, minimal brain dysfunction, dyslexia and developmental aphasia. The term does not include students who have learning problems which are primarily the result of visual, hearing or motor handicaps, of mental retardation, of emotional disturbance, or of environmental, cultural or economic disadvantage. A student who exhibits a discrepancy of 50 percent or more between expected achievement and actual achievement determined on an individual basis shall be deemed to have a learning disability

IDEA's Definition of Learning Disability "... a disorder in one or more of the basic psychological processes involved in understanding or in using language, spoken or written, that may manifest itself in an imperfect ability to listen, think, speak, read, write, spell, or do mathematical calculations, including conditions such as perceptual disabilities, brain injury, minimal brain dysfunction, dyslexia, and developmental aphasia." However, learning disabilities do not include, "…learning problems that are primarily the result of visual, hearing, or motor disabilities, of mental retardation, of emotional disturbance, or of environmental, cultural, or economic disadvantage."

Example of State Requirements for LD Diagnosis

Achievement Intelligence Discrepancy

Severe Discrepancy Determination by Formula Kate obtains an IQ score of 90 and an achievement score of 74. Is this 16-point difference large enough to be considered a ‘significant difference’ between ability and achievement? Data: Ability Score ……………………………………………… Reliability of Ability Score ……………………………. … 0.91 Achievement Score ……………………………………….. 74 Achievement Reliability ………………………………… Correlation Between Ability and Achievement Scores

Methods for Determining Severe Discrepancy Deviation from Grade Level Standard Deviation from the Mean Standard Score Comparison Regression Formula

Deviation from Grade Level difference between grade level functioning and placement “Is a student’s measure of grade level functioning significantly different than his or her grade placement?” For example: – Kate is in grade 6 and is achieving at a 3rd grade level – the 50% discrepancy would be considered a severe discrepancy

Deviation from Grade Level (continued) Problems: – grade equivalent scores are not based on equal units – learning is not linear – example: a third grader two years behind is not comparable to an 11th grader two years behind – least psychometrically sound method

Standard Deviation from the Mean Difference between obtained achievement and normed averages Compares an individual to a group “Is a student’s score on an achievement test discrepant from the test mean by a standard value” To calculate: – change achievement score to z-score – compare the z-score to some predefined discrepancy (e.g., 1.5sd or 1.75 sd)

Standard Deviation from the Mean (continued) Example of Kate – if a severe discrepancy is defined as 1.5 sd – Kate’s achievement score of 74 would transform to a z-score of (74-100)/15=-1.73 – Kate’s discrepancy does qualify as a severe discrepancy Problems: – conceptually different from measures of intrapersonal discrepancies & would qualify all low performing individuals – would not identify many students who would be expected to perform better than the average – does not consider measurement error

Standard Score Comparison Difference between standard scores from ability and achievement tests Compares an individual to himself or herself To calculate: – obtain measures of achievement and ability – change scores to z-scores – subtract achievement z-score from ability z-score and divide by standard error of the difference – compare to predefined severe discrepancy score

Standard Score Comparison (continued) Example of Kate – if a severe discrepancy is defined as 1.5 sd – Kate’s achievement score of 74 would transform to a z-score of (74-100)/15=-1.73 – Kate’s ability score of 90 would transform to a z-score of (90-100)/15=-0.66 – use formula (Z ach -Z ability )/((1-r xx ) + (1-r yy )) 1/2 = ( )/.42 = -2.5 – compare -2.5 to 1.5 (note the severe discrepancy cutoff point is expressed as a positive value but think of it as a discrepancy between achievement and ability that would be a negative value when used to define ld) – because Kate’s discrepancy is larger than the predefined severe discrepancy – Kate’s discrepancy does qualify as a severe discrepancy

Standard Score Comparison (continued) Problems: – assumes that measures of ability perfectly correlate with measures of achievement – e.g., assumes that Kate’s measured IQ of 90 would mean that we expect her achievement score to be 90 – does not consider measurement error

Regression Formula Difference between standard scores from ability and achievement tests using regression formulas – use regression to predict an individual’s achievement score from his or her ability score – includes corrections for measurement error and regression to the mean

Regression Formula (continued) Example regression formula: y’ = r xy (Sy/S x )(IQ -  x) +  y where: y’ = predicted achievement score r xy = correlation between IQ and achievement test S y = standard deviation of achievement test S x = standard deviation of IQ test  x = mean of IQ test  y = mean of achievement test

Effects of Test Reliability or Error of Measurement Tests with high reliability Tests with low reliability

Effects of Correlation Regression to the Mean

Regression Formula (continued) After predicting achievement based on IQ – discrepancy is formed by calculating difference between actual and predicted achievement – the calculated discrepancy is tested for significance – is the discrepancy so large that we would consider it not likely due to chance? Determination is made

Regression Formula (continued) Calculation discrepancy using a severe discrepancy calculator: Kate’s Ability Score90 Achievement Score74 Reliability of Ability Score.91 Achievement Reliability.91 Correlation Between Ability and Achievement Scores.47

Regression Formula (continued) Predicted Achievement Score95 – note: based on IQ score of 90, Kate’s predicted achievement score is “pulled towards the mean” Difference between Predicted and Actual Achievement 21 Magnitude of Difference required at.05 level22 Kate’s discrepancy does not qualify as a severe discrepancy

7490 Kate’s Measured Achievement (74) and Ability (90)

Predicted Achievement Score (95) Based on IQ of 90

Regression Formula (continued) Problems: – complex calculations – excludes many students in lower ability range who would be included using simple discrepancy method Benefit: – most psychometrically sound method

Summary Determination of LD Diagnosis is based in part on: – State determinations of severe discrepancy – method of calculating severe discrepancy Different methods of calculating a discrepancy will result in different students being severely discrepant

Summary Regression models appear to produce proportional racial representation (Braden & Weiss, 1988) Standard score comparison methods may over- identify high ability students and under-identify minority students (Braden & Weiss, 1988) Deviation from grade level or test mean will under-identify high performing students.

Questions Is LD a Valid diagnosis? – can you make inferences based on LD? – Can you make predictions about LD individuals that differ from “low achievement”? Is your method of determining LD consistent with your conception of LD? – e.g., intrapersonal construct vs. interpersonal construct

Validity of LD as Discrepancy Based Construct Cyril Burt (1937) “Capacity must obviously limit content. It is impossible for a pint jug to hold more than a pint of milk and it is equally impossible for a child’s educational attainment to rise higher than his educable capacity (p. 477).” Implies that capacity to learn is fixed

Validity Learning disability is result of unexpected low achievement. Also implies that children with unexpected low achievement (LD) are distinct from expected low achievement (i.e., low achievement and low intelligence).

Validity Validity of construct relies on its uniqueness and utility Validity of a discrepancy based model assumes that ability-achievement discrepant children are qualitatively distinct regular “low achievers. Also assumes that identifying LD will lead to useful interventions specific to that group.

Assessing Validity of LD Fletcher et al. (2001) describe means of validating LD diagnosis – Prognosis – Response to intervention – Distinct cognitive profiles

Cognitive Domains Meta-Analysis Hoskyn & Swanson (2000) Stuebing et al. (2002)

Hoskyn & Swanson “… few recognize that the use of discrepancy scores implies that it accomplishes something beyond their component parts. One obvious test of this notion is whether some children defined by discrepancy scores are more likely to respond favorably to one treatment when compared to those poor achieving children without discrepancies.”

Hoskyn & Swanson “Responsiveness to instruction seems to be a missing test in the majority of studies comparing discrepancy and nondiscrepancy groups. To date, there are no systematic analyses which support the notion that the discrepancy model is a useable construct when it comes to intervention and prognosis of intervention.”

Stuebing et al. Substantial overlap between IQ-discrepant & IQ-consistent poor readers Differences between groups on several cognitive domains were negligible or small Research indicates little need for using IQ tests in assessing LDs

Prognosis Do LD students and ordinary low-achievers differ in development of reading ability? O’Mally et al. (2002) found little evidence of differences between groups. Several longitudinal studies found little or no differences in reading development between groups.

Response to Intervention Research generally finds that discrepancy based LD vs. low-achievers do not respond differently to interventions. Vellutino, Scanlon, Lyon (2000) reported that IQ-achievement discrepancy did not predict differences between groups on responses to mediation or which group would be more easily remediated.

Assessing Validity of LD: Summary Research indicates little or no differences between discrepancy based LD students and ordinary low achievers based on: – Cognitive Profiles – Prognosis – Response to intervention

Validity Current definitions and diagnosis of LD students lacks uniqueness (distinct group of learners) and utility (clear differences in treatment and prognosis).

A New Era: Revitalizing Special Education for Children and their Families President’s Commission on Excellence in Special Education July 1, 2002

Introduction to a New Era Students with disabilities drop out of high school at twice the rate of their peers Most public school educators do not feel well prepared to work with children with disabilities

Introduction to a New Era Almost half of the children in special education are identified as having a specific learning disability- a 300% increase since % of of those with SLD (40% of Sp Ed students) are there because they haven’t learned how to read

Introduction to a New Era Children of minority status continue to be over represented in special education- African American students are twice as likely as whites to be labeled MR and 50% more likely to be designated as emotionally disturbed.

Three Major Recommendations Focus on results-not on the process Embrace a model of prevention not failure Consider children with disabilities as general education children first

“The education of all children, regardless of background or disability must always be a national priority. One of the most important goals of my administration is to support states and local communities in creating and maintaining a system of public education where no child is left behind. Unfortunately, among those at greatest risk of being left behind are children with disabilities” President G. W. Bush, Executive Order 13227

7 Sections Federal Reg’s & Monitoring, paperwork reduction, increased flexibility *Assessment & Identification Sp Ed finance Accountability, flexibility, parental empowerment Post secondary results, effective transition services Teacher/administrator preparation, training, retention Sp Ed research and dissemination

Assessment & Identification Identify and Intervene Early. Implement research-based, early identification and intervention programs to better serve children with learning and behavioral difficulties at an earlier age. Include early screening, prevention, and intervention practices to identify academic and behavioral problems in young children

“ Services first, assessment later,” Commissioner Steve Bartlett

Assessment & Identification Simplify the Identification Process. Simplify the ID and eligibility determination process, and clarify the criteria used to determine the existence of a disability, particularly high incidence disabilities.

“There is no compelling reason to continue the use of IQ tests in the identification of learning disabilities. And, if we eliminate IQ tests from the identification of individuals with LD, we could shift our focus on to making sure that individuals are getting the services that they need and away from the energy that’s going into eligibility determination ” Sharon Vaughn, Ph.D.

Assessment & Identification Incorporate Response to Intervention. Implement models during the identification and assessment process that are based on response to intervention and progress monitoring. Use data from these practices to assess progress in children who receive special education services

I would like to encourage the commission to drive a stake through the heart of this over reliance on the discrepancy model for determining the kinds of children that need services. It doesn’t make any sense to me. I’ve wondered for 25 years why it is that we continue to use it and over rely on it as a way of determining what children are eligible for services in special education. Commissioner Wade Horn

Assessment & Identification Incorporate Universal Design in Accountability Tools. Ensure all tools used to assess students for accountability and the assessment of progress are designed to include any accommodations and modifications for students with disabilities

The real tragedy is that conceptualizations of LD have not changed over 30 years despite the completion of significant research in the past 15 years. What we know form research now needs to be implemented. Lyon, Fletcher, et al.

…We are still in need of data indicating that the cognitive processing of dyslexic and garden variety poor readers reading at the same level is reliably different, data indicating that these 2 groups have a differential educational prognosis, and data indicating that they respond differently to certain educational treatments. These data of course should have been presented in the first place. Stanovich, 1991

NASP Recommendations for IDEA Reauthorization Identification and Eligibility Determination for Students with Specific Learning Disabilities April 25, 2003

NASP Recommendations Maintain current LD definition but change eligibility criteria Eliminate ability-achievement discrepancy Introduce multi-tier model with dual criteria- significantly low underachievement, insufficient response to intervention

Significantly Low Achievement States or School Districts may set criteria for “significantly low achievement” As in current law exclusionary criteria would still apply- not primarily the result of visual, hearing…..

Insufficient Response to Intervention Despite at least 2 empirically based interventions over a period of at least 6 weeks Interventions administered in general education Lack of response not due to low effort, cultural differences, LEP, or nonattendance

Multi-tier model ensures general education support including.. CBA and targeted interventions ensuring literacy and numeracy skill acquisition (primary grades) A systematic problem solving process

Specialized IndividualInterventions (Individual StudentSystem) Continuum of Effective Support Specialized GroupInterventions (At-Risk System) Universal Interventions (School-Wide System Classroom System) Students without Serious Problem (80 -90%) Students At-Risk for Problems (5-15%) Students with Chronic/Intense Problems (1 - 7%) Primary Prevention Secondary Prevention Tertiary Prevention All Students in School

Characteristics of the Multi- Tier Model Tier 1. High quality instructional and behavioral supports for all students in general education

Tier 1. Components include.. Research based instruction & behavior supports Ongoing CBA of basic skills, instructional level matched to students skills Remedial instruction and group interventions within general education

Characteristics of the Multi- Tier Model Tier 2. Targeted intensive prevention or remediation services for students whose performance and rate of progress lag behind the norm for their grade and educational setting

Tier 2. Components include.. Research based/intense services targeted to the student’s individual needs Time limited services Linked to a problem solving process including general & Sp Ed teachers and support services personnel Initiated though formal referral, parental notification and consent

Tier 2. Problem solving includes. Precise charting of progress- general education interventions Formal documentation of progress toward targeted goals A verified level of intervention fidelity Comparison to local norms- if available

Characteristics of the Multi- Tier Model Tier 3. Comprehensive evaluation by a multi-disciplinary team to determine eligibility for special education and related services

Tier 3. Components include.. Low achievement and insufficient response criteria met Referral to a Multidisciplinary Team MDT conducts a comprehensive evaluation

Comprehensive evaluation includes.. Indirect sources of information-i.e., interviews Direct observation Response to intervention- systematic, data based Individual assessment- as prescribed by the team (includes norm referenced and criterion referenced measures of cognitive and academic skills)

Resources for 3 Tier Assessments Free Reading Resources Free Assessment & Intervention Resources Other Tools

Free Reading Resources Report of the National Reading Panel US Department of Education See publications- search for reading The ERIC/OSEP Special Project- Offers Research Connections, Newsbriefs, Topical Briefs, and Awareness campaigns such as Learning to Read, Reading to Learn.

Free Reading Resources International Reading Association Learning Disabilities Association American Federation of Teachers- Building on what works. Five promising reading remediation programs Seven elements of a school wide beginning reading program

Free Assessment & Intervention Resources Good & Kaminski (2002). Dynamic indicators of basic early literacy skills. Complete assessment and manual with probes for letter naming fluency, initial sound fluency, phoneme segmentation fluency, nonsense word fluency, oral reading fluency and retell fluency, word use fluency

Free Assessment & Intervention Resources LSU Reading Center (Joe Witt). Materials for reading placement, reading intervention, and CBM assessments, instructions, and probes.

Free Assessment & Intervention Resources Jim Wright with the Syracuse City School District. Excellent resource compilation of assessment, academic and behavioral interventions Favorite Downloads include Classroom Behavior Report Card Manual, Curriculum-Based Measurement Manual & CBM Workshop, Peer Tutor Training, Reading Interventions Manual, School-Based Intervention Team (SBIT) materials. Also has a CBM Graphing program (Chartdog) and excel.

Free Assessment & Intervention Resources Ron Dumont and John Willis. This website offers an array of resources for assessment and diagnosis including test reviews, classification guidelines, etc. And of course……….. School Psychology Resources online - Sandra Steingart, Ph.D. NASP

Contact Information Michael LeBlanc, Ph.D. James McDougal, Psy.D. This PowerPoint presentation online