Examining Differential Boost from Read Aloud on a Test of Reading Comprehension at Grades 4 and 8 Cara Cahalan-Laitusis Linda Cook Fred Cline Teresa King.

Slides:



Advertisements
Similar presentations
Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the.
Advertisements

Assessment types and activities
Designing Accessible Reading Assessments National Accessible Reading Assessment Projects General Advisory Committee December 7, 2007 Overview of DARA Project.
Copyright © 2004 Educational Testing Service Listening. Learning. Leading. Using Differential Item Functioning to Analyze a State English-language Arts.
National Accessible Reading Assessment Projects Examining Background Variables of Students with Disabilities that Affect Reading Jamal Abedi, CRESST/University.
Copyright © 2006 Educational Testing Service Listening. Learning. Leading. Using Differential Item Functioning to Investigate the Impact of Accommodations.
Impact of Read Aloud on Test of Reading Comprehension Cara Cahalan-Laitusis Educational Testing Service.
Partnership for Accessible Reading Assessment Sampling Issues and Accessible Assessments Christopher Johnstone National Center on Educational Outcomes.
Copyright © 2004 Educational Testing Service Listening. Learning. Leading. Using DIF to Examine the Validity and Fairness of Assessments for Students With.
Examining Differential Boost from Read Aloud on a Test of Reading Comprehension at Grades 4 and 8 Cara Cahalan-Laitusis, Linda Cook, Fred Cline, and Teresa.
National Accessible Reading Assessment Projects DARA Research and Next Steps Cara Cahalan-Laitusis & Linda Cook Educational Testing Service.
National Accessible Reading Assessment Projects (NARAP)
National Accessible Reading Assessment Projects National Accessible Reading Assessment Projects (NARAP)
Listening. Learning. Leading. Using Factor Analysis to Investigate the Impact of Accommodations on the Scores of Students with Disabilities on English-Language.
National Accessible Reading Assessment Projects Partnership for Accessible Reading Assessment (PARA) Martha Thurlow.
Partnership for Accessible Reading Assessment Partnership for Accessible Reading Assessment (PARA) Research Martha Thurlow National Center on Educational.
Designing Accessible Reading Assessments Examining Test Items for Differential Distractor Functioning Among Students with Learning Disabilities Kyndra.
National Accessible Reading Assessment Projects National Accessible Reading Assessment Projects General Advisory Committee December 8, 2006 Overview of.
Principal Investigators: Martha Thurlow & Deborah Dillon Introduction Assumptions & Research Questions Acknowledgments 1. What characteristics of current.
How are we doing? Closing the gap with non-abbotts in Fourth grade Presentation by Gordon MacInnes, Assistant Commissioner of Education, Division of Abbott.
ED PACE Educational Development for Planning and Conducting Evaluations West Virginia Department of Education.
Lecturette 2: Educational Mandates & Universally Designed Large Scale Assessments.
Teacher Training, Teacher Quality and Student Achievement Douglas Harris Tim R. Sass Dept. of Educational Dept. of Economics Policy Studies Florida State.
LINDSAY CLARE MATSUMURA HELEN GARNIER BRIAN JUNKER LAUREN RESNICK DONNA DIPRIMA BICKEL June 30, 2010 Institute of Educational Sciences Conference Evidence.
Accelerated Reader as a Mechanism for Independent Reading Assessment: Reading Gains in Ninth Graders Wendy Stephens CECS 5610 April 29, 2006 Dr. Knezek.
Designing Accessible Reading Assessments Reading Aloud Tests of Reading Review of Research from the Designing Accessible Reading Assessments Projects Cara.
Comparing Growth in Student Performance David Stern, UC Berkeley Career Academy Support Network Presentation to Educating for Careers/ California Partnership.
Reading Comprehension and Math Computation Screening and Progress Monitoring Assessments for Secondary Students Carrie Urshel, Ph.D., School Psychologist.
Ventura County SELPA Pattern of Strengths and Weaknesses (PSW) Model: An Overview This PowerPoint is provided as an overview to the Ventura County SELPA.
Chapter 9 Assessing Studies Based on Multiple Regression.
Designing Accessible Reading Assessments Research on Making Large Scale Assessments More Accessible for Students with Disabilities Institute of Education.
Copyright © 2006 Educational Testing Service Listening. Learning. Leading. 1 College Admissions Testing: Performance, Validity and Use Cara Cahalan-Laitusis.
 Accommodation:  Lang, Elliot, Bolt, and Kratochwill (2008) stated that testing accommodations are changes made to the administration of tests to provide.
CAHSEE California High School Exit Exam. OVERVIEW Purpose of the CAHSEE Purpose of the CAHSEE Background Background Contents of the CAHSEE Contents of.
Including a detailed description of the Colorado Growth Model 1.
Adolescent Literacy and Academic Behavior Self-Efficacy Survey (ALAB) Sharon deFur, Virginia SPDG Evaluation March 2013.
National Accessible Reading Assessment Projects Research on Making Large-Scale Reading Assessments More Accessible for Students with Disabilities June.
Cara Cahalan-Laitusis Operational Data or Experimental Design? A Variety of Approaches to Examining the Validity of Test Accommodations.
Technology to Support Reading Research & Practice.
Putting the Pieces Together with Reader’s Theater The Effects of Reader’s Theater on Sixth Grade Co-taught Students during English/Language Arts Class.
California English Language Development Test CELDT Whittier Union high School District Federal & State Categorical Programs Office.
1 Experimental Analysis of a Curricular Intervention on Student Achievement and Transition Outcomes OSEP Project Directors Conference Margo Vreeburg Izzo,
Closing the Opportunity to Learn Gap for Students with Disabilities Cross-State Research Results Opportunity To Learn– Instructional Alignment Least Restrictive.
Technology Assisted Reading Assessment Cara Cahalan Laitusis Educational Testing Service Martha Thurlow NCEO.
Florida Department of Education Jeanine Blomberg, Commissioner External Factors Review: GRADE 3 FCAT READING 2005, 2006, 2007 Jay Pfeiffer, Deputy Commissioner.
Modified Achievement Tests for Students with Disabilities: Design Strategies and Experimental Results Stephen N. Elliott Vanderbilt University CCSSO’s.
From Screening to Verification: The RTI Process at Westside Jolene Johnson, Ed.S. Monica McKevitt, Ed.S.
Do we have enough evidence on the validity of accommodations to justify the reporting of accommodated assessments? Jamal Abedi University of California,
How can giving ELL students access to learning games on a computer help them learn in the classroom? By: Lisa Cruz.
Martha Van Leeuwen University of Kansas Resources for Paraeducators Website Accommodations and Modifications.
Designing Accessible Reading Assessments A Multistage Adaptive and Accessible Reading Assessment for Accountability Cara Cahalan Laitusis ETS.
Specific MSS outcome data -areas evaluated- Impact on WRITING Impact on VOCABULARY Impact on INFORMATION PROCESSING SKILLS Impact on CONCEPT LEARNING Impact.
Project MORE Evaluation Results Independent Evaluation conducted from 2001-to present by Center for Evaluation Services at Bowling Green State.
Copyright © 2012 by Educational Testing Service. Computer Based Achievement Assessment of Young Students (Grades 1, 2 and 3) Christine M. Mills ETS, Princeton,
How can giving ELL students access to learning games on a computer help them learn in the classroom? By: Lisa Cruz.
School-level Correlates of Achievement: Linking NAEP, State Assessments, and SASS NAEP State Analysis Project Sami Kitmitto CCSSO National Conference on.
Designing Accessible Reading Assessments Putting Accessibility to the Test: Design of a Multistage Reading Assessment for Accountability Cara Cahalan Laitusis.
Latent regression models. Where does the probability come from? Why isn’t the model deterministic. Each item tests something unique – We are interested.
Participation of and Accommodations for Students with Disabilities and English Language Learners NAEP State Analysis Project Jenifer Harr María Pérez CCSSO.
Tips and Guidelines. Chapter Four: Results Assessments Questionnaires/SurveysTest Scores/Report Card Data Rationale Why study is needed?What results will.
Effectiveness of Selected Supplemental Reading Comprehension Interventions: Impacts on a First Cohort of Fifth-Grade Students June 8, 2009 IES Annual Research.
Critical Issues Related to ELL Accommodations Designed for Content Area Assessments The University of Central Florida Cocoa Campus Jamal Abedi University.
C R E S S T / U C L A UCLA Graduate School of Education & Information Studies Center for the Study of Evaluation National Center for Research on Evaluation,
Technology Assisted Reading Assessment “Accessible Reading Assessment” and HTML Cara Laitusis Teresa King Elizabeth Ayad Markku Hakkinen.
Student Achievement Data Mount Olive Township Public Schools.
 Decoding (i.e., Phonics)  Fluency  Comprehension  Inflection  Background Experiences…
Welcome to ELL Mrs. Yi.
Student Mobility and Achievement Growth In State Assessment Mohamed Dirir Connecticut Department of Education Paper presented at National Conference.
Welcome to ELL Mrs. Yi.
CAASPP Results 2015 to 2016 Santa Clara Assessment and Accountability Network May 26, 2017 Eric E, Zilbert Administrator, Psychometrics, Evaluation.
Presentation transcript:

Examining Differential Boost from Read Aloud on a Test of Reading Comprehension at Grades 4 and 8 Cara Cahalan-Laitusis Linda Cook Fred Cline Teresa King

Accommodation vs. Modification States are not in agreement on read aloud on reading tests Many students use read aloud even when not allowed by the state –In California nearly 4,000 fourth graders took the STAR English Language Arts assessment in 2004 with the test read aloud Schools are torn between complying with state policy to not allow read aloud and federal regulations to allow all accommodations used in the classroom

Differential Boost

Prior Research No Differential Boost –Kosciokek & Ysseldyke (2000). Small sample size (n=31) –Meloy, Deville, and Frisbie (2002) – Between subjects design (n=260, 76% non-disabled, random assigned to audio or standard) –McKevitt & Elliott (2003) Small sample size (n=39) Differential Boost –Crawford and Tindal (2004) (n=338, 78% non- disabled) –Fletcher, et. al (2006) Between subjects design (random assigned to audio or standard) and sample included 91 Dyslexic (poor decoder) and 91 average decoders

Differential Boost Design

Data Collected 2 Reading Comprehension Tests –Extra Time –Extra Time with Read Aloud via CD 2 Fluency Measures 2 Decoding Measures ( 4 th grade only ) Student Survey Teacher Survey

Sample th Graders –522 Students with RLD –648 Students without a disability th Graders –394 Students with RLD –461 Students without a disability

Mean Scale Score and Boost RLDNon-LD Grade 4 Standard Audio Boost205 Grade 8 Standard Audio Boost102

Teacher Prediction

Student Prediction

Preliminary Findings Differential Boost at both 4 th and 8 th grades (i.e., students with LD had significantly greater score gains from read aloud than non-LD students) Differential Boost (at both grades) even after controlling for Reading Fluency

Additional Analyses Planned Examine if controlling for decoding and fluency result in differential boost Differential Item Functioning between groups Examine which variables (decoding, fluency, teacher ratings, student ratings) best predict boost from audio

Additional Analyses Planned Predictive Validity of test scores –Compute regression equation for non- RLD standard score to other measure of RC (e.g., teacher ratings, state test scores, and/or fluency measure –Examine over/under estimations of non-LD audio, RLD audio, and RLD standard