Growth Model Considerations in Early Literacy Research Yaacov Petscher Florida Center for Reading Research.

Slides:



Advertisements
Similar presentations
Performance Measurement and Evaluation 2/8/2014 Performance Measurement and Evaluation 1 Performance Measurement and Evaluation What are they? How are.
Advertisements

The Examination of Equivalence and Equating First-Grade DIBELS ORF Chung-Hau Fan The University of Iowa.
DIBELs Next…. Oh my, What’s Next?
WELCOME to DIBELS Night 6:00 – 6:30 Dinner 6:30 – 7:00 Children: Story Teller Parents: DIBELS presentation on 1 st /2 nd grade assessments at Wilcox 7:00.
Comparison of Half- and Full-Day Kindergarten on Kindergarten Achievement Jack B. Monpas-Huber, Ph.D. Director of Assessment and Student Information.
Understanding DIBELS Next
STAR Assessments: Using data to drive your instruction 2012.
Survey Level Assessment
Chapter 17 Making Sense of Advanced Statistical Procedures in Research Articles.
Cohort A Project-wide Data “Our goals can only be reached through a vehicle of a plan, in which we must fervently believe, and upon which we must vigorously.
RTI Data-based Decisions Marilyn Bechtel Psychologist/Elliott Elementary School Lincoln Public Schools July 30, 2007.
GRA 6020 Multivariate Statistics Ulf H. Olsson Professor of Statistics.
Using Hierarchical Growth Models to Monitor School Performance: The effects of the model, metric and time on the validity of inferences THE 34TH ANNUAL.
1 Cohort B Institute on Beginning Reading III February 1 and 2, 2006 Achieving Healthy Grade-Level Systems in Beginning Reading.
GRA 6020 Multivariate Statistics Ulf H. Olsson Professor of Statistics.
1 Project-wide Reading Results: Interpreting Student Performance Data and Designing Instructional Interventions Oregon Reading First February, 2004 Institute.
S-005 Types of research in education. Types of research A wide variety of approaches: –Theoretical studies –Summaries of studies Reviews of the literature.
Chapter 9 Fluency Assessment Tina Jensen. What? Fluency Assessment Consists of listening to students read aloud for a given time to collect information.
Determining Informative Student Growth on the Florida Assessments for Instruction in Reading Yaacov Petscher, Ph.D. Director of Research Florida Center.
DIBELS Information Night for Kindergarten Parents Monday, September 24, 200 6:30 – 7:30 P.M. Mirage Elementary Media Center Information about what DIBELS.
Issues in structural equation modeling Hans Baumgartner Penn State University.
1 An Autoregressive latent Trajectory Model of Resident Outcome Improvement in Nursing Homes Thomas T.H. Wan, Ph.D., M.H.S. Professor and Director Public.
Neither Was Intervention! Rome Wasn’t Built in a Day!
An exposition by Stephanie Stevens. What is DIBELS? DIBELS stands for Dynamic Indicators of Basic Literacy Skills. It is a form of assessment that is.
1 The Added Value of Measuring Growth within an RtI Framework Vicki L. Collins & Janet K. Holt Northern Illinois University.
What Can Test Scores Tell You about the State of Your School?  CRCT  DIBELS Dr.Michael McKenna Georgia Southern University.
Exploring the biometric dual change score model in the co-development of reading fluency and reading comprehension C. Little, S.A. Hart 12, C. Schatschneider.
Discovering the Causes of Problem Gambling: Overcoming Methodological Challenges Donald Schopflocher, PhD Associate Professor, School of Public Health,
DIBELS Overview Kindergarten. What is DIBELS?? Kindergarten Assessments DIBELS Report What can parents do at home?
From Screening to Verification: The RTI Process at Westside Jolene Johnson, Ed.S. Monica McKevitt, Ed.S.
DIBELS Overview First and Second Grade.
DIBELS Data: From Dabbling to Digging Interpreting data for instructional decision-making.
Data Analysis MiBLSi Project September 2005 Based on material by Ed Kameenui Deb Simmons Roland Good Ruth Kaminski Rob Horner George Sugai.
HOW DO WE USE DIBELS WITH AN OUTCOMES-DRIVEN MODEL? Identify the Need for Support Validate the Need for Support Plan Support Evaluate Effectiveness of.
Student Miscue Analysis Presentation REA 628. Student Information  John* is a 6 year old Caucasian male.  He is grouped in a lower level reading group.
Class Action Research: Treatment for the Nonresponsive Student IL510 Kim Vivanco July 15, 2009
ELLA Module 3 Assessments and Interventions. Goals for Today: Participants will be able to: Identify the four purposes for assessment. Align DIBELS assessments.
RtI Team 2009 Progress Monitoring with Curriculum-Based Measurement in Reading -DIBELS.
Data-Based Decision Making: Universal Screening and Progress Monitoring.
Tallassee Elementary Summary of Effectiveness DIBELS Report Data Meeting May 9, 2012 Presenter: Cynthia Martin, ARI Reading Coach.
DIBELS: Doing it Right –. Big Ideas of Today’s Presentation Reading success is built upon a foundation of skills DIBELS (Dynamic Indicators of Basic Early.
Interpreting data for program evaluation and planning.
S-005 Types of research in education. Types of research A wide variety of approaches: –Theoretical studies –Summaries of studies Reviews of the literature.
Developmental Models: Latent Growth Models Brad Verhulst & Lindon Eaves.
Dynamic Indicators of Basic Early Literacy Skills
The State of the School Fall Goals What do we want children to know and be able to do with text in this school? We want our children to know how.
Vision: Every child in every district receives the instruction that they need and deserve…every day. Oregon Response to Intervention Vision: Every child.
Progress Monitoring Goal Setting Overview of Measures Keith Drieberg, Director of Psychological Services John Oliveri, School Psychologist Cathleen Geraghty,
Intensive Reading Support 6.0 Evaluate Instructional Support 21.
Policy & practice Some thoughts There is no assessment panacea. There are strengths and weaknesses for both observation and question- based assessment.
Responsiveness of Students With Language Difficulties to Early Intervention in Reading O’Conner, R.E., Bocian, K., Beebe-Frankenberger, M., Linklater,
NEFEC EARLY READING FIRST REACH Raising Expectations for Niblack Elementary.
RtI Team 2009 Progress Monitoring with Curriculum-Based Measurement in Reading - AIMS.
Testing the Equality of Means and Variances in Over-Time Data David A. Kenny.
RTI Trends & Issues Keith Drieberg Brad McDuffee San Bernardino City Unified School District Keith Drieberg Brad McDuffee San Bernardino City Unified School.
Addressing Questions with KN, 1st and 2nd Grade Reading
STAR Reading. Purpose Periodic progress monitoring assessment Quick and accurate estimates of reading comprehension Assessment of reading relative to.
DIBELS.
Assistant Principal’s Meeting Miami-Dade County Public Schools
Structural Equation Modeling using MPlus
Data Review Team Time Fall 2013.
Data Review Team Time Winter 2014.
Data-Based Leadership
CASD K-6 Transition Plan from DIBELS to DIBELS Next
Weaver Elementary School
mClass Training for New Staff
Angela B. Bradford School of Family Life
Program Effectiveness in DERF: State-Level Action Plan
Data-based Decisions: You try it
Rachael Bedford Mplus: Longitudinal Analysis Workshop 23/06/2015
Presentation transcript:

Growth Model Considerations in Early Literacy Research Yaacov Petscher Florida Center for Reading Research

What do we want to model? How students are changing over time Individual differences in change How change in one skill relates to change in another Causes of individual change Causes of individual differences in individual change

Progress Monitoring What does growth in syntax ability look like in K? Do students differ in their growth patterns in syntax? What is the relationship between growth in syntax and growth in listening comprehension? What causes growth in syntax? What causes individual differences in syntax growth?

Univariate Longitudinal Factor Analysis

Multivariate Longitudinal Factor Analysis

Univariate Simplex Modeling

Cross-Lagged Latent Regression

Latent Growth

Parallel Process Latent Growth

Latent Growth SEM

So what? Each model exists for a specific purpose Differences contribute to individual practical problems – Minimum N – # of Occasions – # of Variables Can we combine the growth and causal models to extract similar types of information?

Latent Change Scores

Bivariate Latent Change Scores

Research Questions What are the growth trajectories of students’ early literacy skills? Can these be better informed by dynamic developmental relations? Are there differences in dynamic developmental relations between-students vs. between- classes?

Data and Measures Sample size = 77,675 students; 4,774 classes DIBELS Assessments – ISF: Kindergarten – LNF: K-1 – PSF: K-1 – NWF: K-2 – ORF: 1-3 Something reliability/validity

Analyses Univariate LCS – Evaluate patterns Multivariate LCS – Evaluate contributors to LCS Multilevel LCS – Evaluate differences in estimated effects by classes and students

LNF CFI =.95 TLI =.95 RMSEA =.11 SRMR =.08

PSF CFI =.94 TLI =.95 RMSEA =.09 SRMR =.09

NWF CFI =.90 TLI =.90 RMSEA =.12 SRMR =.09

ORF CFI =.94 TLI =.94 RMSEA =.12 SRMR =.06

Just…no… Modelχ²dfRMSEACFITLIBIC Contrained MLCS Freed MLCS

LNF ΔLNF1ΔLNF2ΔLNF3ΔLNF4 LNF10.80 LNF LNF30.12 LNF PSF10.10 PSF20.03 PSF NWF10.36 NWF20.08 NWF g g10.50

Range Differences

NWF ΔNWF1ΔNWF2ΔNWF3ΔNWF4ΔNWF5ΔNWF6ΔNWF7ΔNWF8ΔNWF9 NWF10.65 NWF20.93 NWF30.7 NWF40.58 NWF50.4 NWF60.11 NWF70.3 NWF80.22 NWF90.2 PSF10.15 PSF2-0.3 PSF PSF40.24 PSF PSF60.04 LNF10.35 LNF2-0.4 LNF30.01 LNF LNF50.52 ORF10.18 ORF ORF30.21 ORF ORF50.12 ORF60.11

NWF ΔNWF1ΔNWF2ΔNWF3ΔNWF4ΔNWF5ΔNWF6ΔNWF7ΔNWF8ΔNWF9 NWF10.65 NWF20.93 NWF30.7 NWF40.58 NWF50.4 NWF60.11 NWF70.3 NWF80.22 NWF90.2 PSF10.15 PSF2-0.3 PSF PSF40.24 PSF PSF60.04 LNF10.35 LNF2-0.4 LNF30.01 LNF LNF50.52 ORF10.18 ORF ORF30.21 ORF ORF50.12 ORF60.11

How to use the scores Create vector plots Determinant importance – Comparing graphs – Relative importance – Screening applications

Multilevel LCS Model Comparisons – Parallel Process – Constant Change Fixed Proportional at Levels – Dual Change-Constrained Lag ModelX2dfAICBICRMSEA Parallel Process Growth Constant - Fixed BW Constant Change - Fixed Between Constant Change - Fixed Within Dual Change Δχ² (2) = 169, p <.001

Conclusions LCS can help inform change and causation May be useful for informing multivariate screening Better target interventions They are a pain to run