Interpreting Test Results using the Normal Distribution Dr. Amanda Hilsmier.

Slides:



Advertisements
Similar presentations
Ed-D 420 Inclusion of Exceptional Learners. CAT time Learner-Centered - Learner-centered techniques focus on strategies and approaches to improve learning.
Advertisements

Scoring Terminology Used in Assessment in Special Education
Richard M. Jacobs, OSA, Ph.D.
© 2008 McGraw-Hill Higher Education The Statistical Imagination Chapter 4. Measuring Averages.
Measures of Central Tendency. Central Tendency “Values that describe the middle, or central, characteristics of a set of data” Terms used to describe.
STANDARDIZED TESTING MEASUREMENT AND EVALUATION  All teaching involves evaluation. We compare information to criteria and ten make judgments.  Measurement.
Descriptive Statistics Chapter 3 Numerical Scales Nominal scale-Uses numbers for identification (student ID numbers) Ordinal scale- Uses numbers for.
Appraisal in Counseling Session 2. Schedule Finish History Finish History Statistical Concepts Statistical Concepts Scales of measurement Scales of measurement.
Copyright 2001 by Allyn and Bacon Standardized Testing Chapter 14.
Classroom Assessment A Practical Guide for Educators by Craig A
The Data Analysis Plan. The Overall Data Analysis Plan Purpose: To tell a story. To construct a coherent narrative that explains findings, argues against.
1 Chapter 4 Statistical Concepts: Making Meaning Out of Scores.
Standardized Testing (1) EDU 330: Educational Psychology Daniel Moos.
Statistics Used In Special Education
Statistics. Question Tell whether the following statement is true or false: Nominal measurement is the ranking of objects based on their relative standing.
1.3 Psychology Statistics AP Psychology Mr. Loomis.
Chapter 3 Understanding Test Scores Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition.
Chapter 11 Descriptive Statistics Gay, Mills, and Airasian
Descriptive Statistics
Scores & Norms Derived Scores, scales, variability, correlation, & percentiles.
Instrumentation (cont.) February 28 Note: Measurement Plan Due Next Week.
Thinking About Psychology: The Science of Mind and Behavior 2e Charles T. Blair-Broeker Randal M. Ernst.
Describing Behavior Chapter 4. Data Analysis Two basic types  Descriptive Summarizes and describes the nature and properties of the data  Inferential.
1.  DATA ANALYSIS  PROCESSING DATA  Editing Data  Process for coding 2.
Listening to Bob Marley makes me think of statistics and standardized testing….. Said no one ever But… it is still your responsibility.
Interpreting Performance Data
Descriptive Statistics
Chapter 6 Foundations of Educational Measurement Part 1 Jeffrey Oescher.
Dr. Serhat Eren 1 CHAPTER 6 NUMERICAL DESCRIPTORS OF DATA.
Appraisal and Its Application to Counseling COUN 550 Saint Joseph College For Class # 3 Copyright © 2005 by R. Halstead. All rights reserved.
Chapter 2 ~~~~~ Standardized Assessment: Types, Scores, Reporting.
Z-Scores Standardized Scores. Standardizing scores With non-equivalent assessments it is not possible to develop additive summary statistics. –e.g., averaging.
Basic Statistical Terms: Statistics: refers to the sample A means by which a set of data may be described and interpreted in a meaningful way. A method.
TYPES OF SCORES (PP IN HUTCHINSON; MERRELL & PLANTE; SECOND PART OF HAYNES AND PINDZOLA )
 Two basic types Descriptive  Describes the nature and properties of the data  Helps to organize and summarize information Inferential  Used in testing.
Three Broad Purposes of Quantitative Research 1. Description 2. Theory Testing 3. Theory Generation.
Chapter 6: Analyzing and Interpreting Quantitative Data
BASIC STATISTICAL CONCEPTS Chapter Three. CHAPTER OBJECTIVES Scales of Measurement Measures of central tendency (mean, median, mode) Frequency distribution.
Experimental Methods: Statistics & Correlation
1 Outline 1. Why do we need statistics? 2. Descriptive statistics 3. Inferential statistics 4. Measurement scales 5. Frequency distributions 6. Z scores.
Standardized Testing. Basic Terminology Evaluation: a judgment Measurement: a number Assessment: procedure to gather information.
STATISTICS STATISTICS Numerical data. How Do We Make Sense of the Data? descriptively Researchers use statistics for two major purposes: (1) descriptively.
Notes 5.1 Measures of Central Tendency A measure of central tendency is a single number that is used to represent a set of data. Measures of central tendency.
The Normal Distribution and Norm-Referenced Testing Norm-referenced tests compare students with their age or grade peers. Scores on these tests are compared.
Chapter 3 Selection of Assessment Tools. Council of Exceptional Children’s Professional Standards All special educators should possess a common core of.
Educational Research: Data analysis and interpretation – 1 Descriptive statistics EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.
Standardized Testing EDUC 307. Standardized test a test in which all the questions, format, instructions, scoring, and reporting of scores are the same.
Measures of Central Tendency (MCT) 1. Describe how MCT describe data 2. Explain mean, median & mode 3. Explain sample means 4. Explain “deviations around.
Psychology’s Statistics Appendix. Statistics Are a means to make data more meaningful Provide a method of organizing information so that it can be understood.
STATISTICS STATISTICS Numerical data. How Do We Make Sense of the Data? descriptively Researchers use statistics for two major purposes: (1) descriptively.
Educational Research Descriptive Statistics Chapter th edition Chapter th edition Gay and Airasian.
AP PSYCHOLOGY: UNIT I Introductory Psychology: Statistical Analysis The use of mathematics to organize, summarize and interpret numerical data.
Introductory Psychology: Statistical Analysis
But… it is still your responsibility
Introductory Statistics
Data Usage Response to Intervention
Standardized Testing (1)
Science of Psychology AP Psychology
STATS DAY First a few review questions.
Module 8 Statistical Reasoning in Everyday Life
Statistical Evaluation
Psychology Statistics
Using statistics to evaluate your test Gerard Seinhorst
Data Tables Packet #19.
But… it is still your responsibility
Evaluation and Assessment of the Individual: Week 2 Discussion
Chapter 4 Standardized Tests.
But… it is still your responsibility
Relationship between Standardized and Classroom-based Assessment
Descriptive statistics for groups:
Presentation transcript:

Interpreting Test Results using the Normal Distribution Dr. Amanda Hilsmier

Major Purposes of Assessment Gather information Answer important questions Instructional planning Monitor student program Evaluate program effectiveness

Guidelines for Assessment Nondiscriminatory Focused on educational needs Comprehensive Technically adequate tools and administered by trained professionals Protect rights of students and parents

Comprehensive assessment IQ test Achievement test Rating scales (behavior, attentional, emotional, &/or adaptive behavior) Classroom observations Parent interviews Work samples Assessments from other personnel (speech-language pathologist, occupational therapist, physical therapist, nurse/doctor, etc. Hearing/vision, if necessary

Measurement Error Assessment has room for measurement error Scores would differ when administering the same instrument to the same student with the same examiner Test scores are observed scores that are made up of 2 scores: a hypothetical true score and an error component The standard error of measurement estimates the amount of error in a score The confidence interval uses the measurement error +/- the obtained score to give a range for where the true score could fall

Descriptive Statistics Measures of central tendency Measures of variability Measures of correlation

Measures of Central Tendency The mean is the arithmetic average from a set of values The mode is the most frequently occurring score among a set of values The median is the middle score in a set of values

Measures of Variability The range is the difference between the highest and lowest score The standard deviation accounts for the relationship of the score from the mean

Results from Informal Measures Frequency counts (number of questions, items, or problems answered correctly) Percentages out of number answered correctly and total attempted Duration measures the time elapse

Results from Norm- referenced Measures Raw score: number of items answered correctly Age/Grade scores: express test performance in terms of grade or age in school Percentile ranks: percentage of individuals in the norm group who achieved the specific raw score or a lower one Standard Scores: raw scores transformed to a new scale with a set mean and standard deviation

What do derived scores tell us? How do we know what a standard score or percentile rank means? We must look at the mean and standard deviation for that test score.

Which is better a grade equivalent score or a standard score? What do you feel more comfortable interpreting? Why? What tells us more a 3 rd grader with a standard score of 84 on letter-word identification or a grade equivalency score of 1.7? Let’s examine the difference between these two scores with the grade equivalency exercise.

Considerations when evaluating grade and/or age equivalent scores Does not provide information on whether student’s performance is within average limits (hard to discern if one-year difference in reading is enough to rule a child eligible for services) Only provides precise information about a student’s instructional or developmental level (often means raw score is equivalent to that particular age or grade group) Grade scores do not describe the student’s current instructional level.

What is the normal distribution? IQ scores and other standard scores are normally distributed The standard normal distribution is a bell-shaped curve which represents the percentage of students that score in a particular range The standard normal distribution has a mean of 0 and a standard deviation of 1. The mean is usually 100 and the standard deviation is typically 15.

Why do you need to know about the normal distribution? Why would it be important?

What does an IQ score of 89 tell me about a student? The student is in the low average IQ range is average is low average while is high average The student is in the 23 rd percentile The means that this student scored at or above 23% of the students in his/her age range Can we know anything else from this score alone?

Not really we need more information What is the students’ current academic performance? What are his/her grades in school? Is he failing a course? If so, what course? Has he/she been retained?

Sample score results for Susie 7 th grade student Has a D in social studies Failing Math, Science, and Reading Held back in the 1 st grade because socially immature and behind peers academically Not a behavioral problem-very shy and insecure

Sample score results for Susie WISC- III VIQ WISC- III PIQ WISC- III FSIQ WJ-III L-W ID WJ-III Pass Comp WJ-III Math Calc WJ-III Math Reas 90 (25%) 72 (3%) 78 (7%) 65 (1%) 78 (7%) 56 (<1%) 73 (4%)

What do these scores mean? How do you explain these scores to a parent? What makes sense to a parent or a regular education teacher? What if you do not have the grade or age equivalents on the students’ score report?