Individual Centered Growth PCRC San Diego, California February, 2012 A. Jackson Stenner Chairman & CEO, MetaMetrics Research Professor University of North.

Slides:



Advertisements
Similar presentations
Mississippi Statewide Teacher Appraisal Rubric (M-STAR)
Advertisements

International Center for Leadership in Education
DATA IS OUR DEFENSE A Grassroots Approach to Balancing Assessment in the U.S.
Preparing Students for the 21 st Century Bill Daggett, Founder and Chairman May 15, 2013.
Daggett System for Effective Instruction: Creating an Action Plan Willard R. Daggett Raymond McNulty.
FirstSchool : Improving the PreK-3 rd Grade School Experience of African-American, Latino, and Low Income Children Looking Back and Looking Ahead: Developing.
Student Futures Project Policy Luncheon Austin, TX December 17, 2013.
California Common Core State Standards
Northern Humboldt Union High School District October 14, 2013 Common Core Activity.
Non-Experimental designs: Developmental designs & Small-N designs
How Economic Justice Can Create Economic Prosperity: The Year Up Model.
SLG Goals, Summative Evaluations, and Assessment Guidance Training LCSD#7 10/10/14.
Miami ISD Texas Academic Performance Report (TAPR)
A Snapshot. Schools  Dresden Elementary School Pre K – 4 (450)  Dresden Middle School 5 – 8 (400)  Dresden High School 9 – 12 (360)  Gleason School.
Let’s Get to the Core Presented by: Benjamin Joseph Media Specialist
Non-experimental Designs
This presentation constitutes the confidential information of MetaMetrics, Inc. Copyright © 2013 MetaMetrics, Inc. All rights reserved. International Reading.
1. Review- What is Science Explain- What kinds of understandings does science contribute about the natural world Form an Opinion- Do you think that scientists.
PROPOSED MULTIPLE MEASURES FOR TEACHER EFFECTIVENESS
1 Artifact Corrected Correlations between theoretical text complexity and empirical text complexity PCRC – San Diego February 7-10, 2013 A.Jackson Stenner.
8/25/2009Lecture 11 STOR 155 Introductory Statistics Lecture 1: Overview The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL.
Longitudinal Experiments Larry V. Hedges Northwestern University Prepared for the IES Summer Research Training Institute July 28, 2010.
Non-Experimental designs: Developmental designs & Small-N designs
Non-Experimental designs: Developmental designs & Small-N designs
Agenda for January 25 th Administrative Items/Announcements Attendance Handouts: course enrollment, RPP instructions Course packs available for sale in.
BHS Methods in Behavioral Sciences I
Non-Experimental designs
Marketing Research and Information Systems
Chapter 2: The Research Enterprise in Psychology
Chapter 3 The Research Design. Research Design A research design is a plan of action for executing a research project, specifying The theory to be tested.
1 Causal Rasch Models IOMW April 11-12, 2012 Vancouver, Canada A.Jackson Stenner Donald S. Burdick Mark H. Stone.
Educator Preparation, Retention, and Effectiveness Ed Fuller University Council for Educational Administration and The University of Texas at Austin February.
UNDERSTANDING LEXILES Lancaster School District Department of Curriculum, Instruction & Assessment.
MULTIPLE MEASURES What are they… Why are they… What do we do… How will we know… Dr. Scott P. Myers KLFA Wednesday, August 28, 2013.
1 Today Null and alternative hypotheses 1- and 2-tailed tests Regions of rejection Sampling distributions The Central Limit Theorem Standard errors z-tests.
T tests comparing two means t tests comparing two means.
Chap 20-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 20 Sampling: Additional Topics in Sampling Statistics for Business.
Liru Zhang, Delaware DOE Shudong Wang, NWEA Presented at the 2015 NCSA Annual Conference, San Diego, CA 1.
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
CALIFORNIA DEPARTMENT OF EDUCATION Tom Torlakson, State Superintendent of Public Instruction Common Core State Standards Professional Learning Module Series.
Unpublished Work © 2005 by Educational Testing Service Growth Options for California County and District Evaluators’ Meetings May 10 and 19, 2005.
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
CALIFORNIA DEPARTMENT OF EDUCATION Jack O’Connell, State Superintendent of Public Instruction Results of the 2005 National Assessment of Educational Progress.
1 Virtual COMSATS Inferential Statistics Lecture-16 Ossam Chohan Assistant Professor CIIT Abbottabad.
Personalized Learning Platforms Imagine a World Where… A. Jackson Stenner Carl Swartz Sean Hanlon Colin Emerson.
1 Causal Rasch Models and Individual Growth Trajectories National Center for the Improvement of Educational Assessment January 18, 2011 A.Jackson Stenner.
Perspectives on Text Complexity in 2011 February 23, 2011 Presented by: A. Jackson Stenner.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Using Specialized Research Designs.
1 How to Model and Test for the Mechanisms that make Measurement Systems Tick IMEKO Jena, Germany Wednesday, August 31, 2011 A.Jackson Stenner Chairman.
Non-Experimental designs
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
Non-Experimental designs Psych 231: Research Methods in Psychology.
T tests comparing two means t tests comparing two means.
Chapter 06 Marketing Research and Information Systems Part Three Target Market Selection and Research.
College Expectations with High School Skills: What is a well-educated high school graduate? Texas High School Project.
CREATING A THESIS STATEMENT Presented by Deidra Powell.
Carolina Melo, Pelusa Orellana, Jill Fitzgerald, Kattia Muñoz
Governor’s Teacher Network
Teaching and Educational Psychology
The Basics of Social Research 2/e
Analyzing Reliability and Validity in Outcomes Assessment Part 1
5th Grade Science Vocabulary
Cardinal Convo April &
Chapter 1 The Science of Biology.
The Lexile Frameworks for Reading and Writing
Analyzing Reliability and Validity in Outcomes Assessment
Non-Experimental designs
Toward a Theory Relating Text Complexity, Reader Ability and Comprehension AERA New Orleans April 10, 2011 Jackson Stenner Chairman & CEO, MetaMetrics.
A Causal Model for Relating Text Complexity, Reader Ability and Comprehension Pacific Coast Reading Conference February 3-6, 2011 Jackson Stenner Chairman.
Presentation transcript:

Individual Centered Growth PCRC San Diego, California February, 2012 A. Jackson Stenner Chairman & CEO, MetaMetrics Research Professor University of North Carolina, Chapel Hill

A Paradigm Shift  “Most analysis efforts in learning and development still focus on data averaged across subjects. There is a growing realization of the limitations of this time- honored approach.” Molenaar and Newell,  “Nevertheless, in the social sciences researchers often discuss and interpret findings on the basis of population- or group-level variance, as if they applied to explaining causal processes at the individual level.” Loken,  “There is an exciting convergence occurring in the social sciences with increasing interest in single-subject designs and self-experimentation, awareness of the necessity for single-subject data to support the logic of scientific inference regarding the dynamics of change, and the availability of methods for the collection of continuous individual-level data.” Loken, 2010.

 Reading and writing research seems to be almost exclusively focused on models that aggregate data across people. Evidence for effective instructional programs is typically focused on what is advantageous on average for a population. The issue is not whether such a strategy can ever uncover individual centered causal processes it is rather that it is rarely acknowledged that it may not. Stenner, 2012

What is Ergodicity?  Three assumptions must be met if findings based on between-person analyses can be applied to inferences about within person processes: (1) the same attribute is being measured at all time points for all persons, (2) there are no trends or cycles in the longitudinal data, and (3) a single function form for the growth trajectory (e.g. quadratic) is applicable for all persons.

What if the developmental process for reading is non-ergotic?  Then we error when we use models of between person variation to support inferences about within person developmental processes.

May 2016 (12 th Grade) Text Demands for College and Career May 2007 – April Encounters 138,695 Words 3,342 Items 983 Minutes Student th Grade Male Hispanic Paid Lunch Expected: 73.5% Observed: 71.7%

Measurement Error What is Known?Individual Standard Error of Measurement Student is in the District (grade unknown) 400L Only grade is known220L One fifty item reading test score is known 110L 3 ½ years of learning Oasis data Growth trajectory is known 11L

A. Jackson Stenner. Chairman & CEO, MetaMetrics Research Professor, UNC, Chapel Hill Contact Info: