The Normal Distribution and Norm-Referenced Testing Norm-referenced tests compare students with their age or grade peers. Scores on these tests are compared.

Slides:



Advertisements
Similar presentations
Measuring Growth Using the Normal Curve Equivalent
Advertisements

Scoring Terminology Used in Assessment in Special Education
Interpreting Results from the Iowa Test of Basic Skills and the Cognitive Abilities Test (ITBS/CogAT) A Parent Guide.
Standardized Tests What They Measure How They Measure.
Wide Range Achievement Test WRAT4 Authors: Gary S. Wilkinson, PhD Gary J. Robertson, PhD.
DETERMINING ELIGIBILITY IN MA EARLY INTERVENTION A General Overview to Scoring.
Objectives Look at Central Limit Theorem Sampling distribution of the mean.
Descriptive Statistics Chapter 3 Numerical Scales Nominal scale-Uses numbers for identification (student ID numbers) Ordinal scale- Uses numbers for.
Chapter 4 Translating to and from Z scores, the standard error of the mean and confidence intervals Welcome Back! NEXT.
Copyright 2001 by Allyn and Bacon Standardized Testing Chapter 14.
Interpreting Standardized Tests Gronlund, Chapter 12 Burke, Chapter 2.
Cognitive Abilities Test (CogAT) and AIG Identification Process Understanding the Student Profile and its Use for Educational Planning and AIG Identification.
Chapter 4 Translating to and from Z scores, the standard error of the mean and confidence intervals Welcome Back! NEXT.
Chapter 9 Flashcards. measurement method that uses uniform procedures to collect, score, interpret, and report numerical results; usually has norms and.
About the tests PATMaths Fourth Edition:
Standardized Test Scores Common Representations for Parents and Students.
Classroom Assessment A Practical Guide for Educators by Craig A
Interpretation of the WISC-IV
Introduction to GREAT for ELs Office of Student Assessment Wisconsin Department of Public Instruction (608)
But What Does It All Mean? Key Concepts for Getting the Most Out of Your Assessments Emily Moiduddin.
Standardized Tests. Standardized tests are commercially published tests most often constructed by experts in the field. They are developed in a very precise.
Basic Statistics Standard Scores and the Normal Distribution.
Standardized Testing (1) EDU 330: Educational Psychology Daniel Moos.
Standardization the properties of objective tests.
Understanding and Interpreting Standardized Assessment Measures Joe Hannah, Hilary Wilson, and Chris Sowder.
Reading Your Child’s Cognitive Abilities Test Profile Bonnie O’Regan Advanced Learning Program Facilitator Greenwich Public Schools February 5, 2014 (snowdate:
Interpreting Test Scores: Making Sense of the Numbers
The Role of Confidence Intervals in Research 1. A study compared the serum HDL cholesterol levels in people with low-fat diets to people with diets high.
LECTURE 06B BEGINS HERE THIS IS WHERE MATERIAL FOR EXAM 3 BEGINS.
Chapter 3 Understanding Test Scores Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition.
SAT 10 (Stanford 10) 2013 Nakornpayap International School Presentation by Ms.Pooh.
Scores & Norms Derived Scores, scales, variability, correlation, & percentiles.
Review of Basic Tests & Measurement Concepts Kelly A. Powell-Smith, Ph.D.
Reliability & Validity
Introduction to GREAT for ELs Office of Student Assessment Wisconsin Department of Public Instruction (608)
CogAT Cognitive Abilities Test ™ Report to Parents What does CogAT measure? CogAT measures cognitive development of a student in the areas of learned reasoning.
Standardized Testing (1) EDU 330: Educational Psychology Daniel Moos.
Understanding ITBS Scores A Guide for Parents Created By: Ginger Psalmonds/CST New Prospect Elementary.
ELA & Math Scale Scores Steven Katz, Director of State Assessment Dr. Zach Warner, State Psychometrician.
NORMS. Scores on psychological tests are most commonly interpreted by reference to norms ; which represent the test performance of the standardized sample.
Chapter 2 ~~~~~ Standardized Assessment: Types, Scores, Reporting.
Z-Scores Standardized Scores. Standardizing scores With non-equivalent assessments it is not possible to develop additive summary statistics. –e.g., averaging.
Chapter 4 & 5 The Normal Curve & z Scores.
Assessing Learners with Special Needs: An Applied Approach, 6e © 2009 Pearson Education, Inc. All rights reserved. Chapter 5: Introduction to Norm- Referenced.
Psychometrics. Goals of statistics Describe what is happening now –DESCRIPTIVE STATISTICS Determine what is probably happening or what might happen in.
Measurement MANA 4328 Dr. Jeanne Michalski
Understanding ITBS Scores A Parent Guide. Overview ITBS testing is done in October at BMS. The testing is a “norm-referenced” test that compares a student’s.
Cognitive Abilities Test (CogAT)
Standardized Testing. Basic Terminology Evaluation: a judgment Measurement: a number Assessment: procedure to gather information.
SAT-10/ARMT Results (Stanford 10),was administered to Alabama students in Grades 3-8 for the first time in April Norm-referenced scores Enable us.
Review: Stages in Research Process Formulate Problem Determine Research Design Determine Data Collection Method Design Data Collection Forms Design Sample.
Standardized Testing EDUC 307. Standardized test a test in which all the questions, format, instructions, scoring, and reporting of scores are the same.
Assessment Assessment is the collection, recording and analysis of data about students as they work over a period of time. This should include, teacher,
Understanding ERB Scores
Chapter 3.3 – 3.4 Applications of the Standard Deviation and Measures of Relative Standing.
Parent’s Guide to Individual Profile Report
Understanding ITBS Scores A Parent Guide. Overview ITBS testing is given in the Fall of each year to students in grades 1 – 8 enrolled in Crosscreek Charter.
Interpreting Test Results using the Normal Distribution Dr. Amanda Hilsmier.
STAR Reading. Purpose Periodic progress monitoring assessment Quick and accurate estimates of reading comprehension Assessment of reading relative to.
A QUANTITATIVE RESEARCH PROJECT -
Nuts and Bolts of Assessment
What is Value Added?.
Understanding ITBS Scores
Data Usage Response to Intervention
SCORING TERMINOLOGY USED IN ASSESSMENT
Cognitive Abilities Test (CogAT)
Understanding ITBS Scores
TABE II: Using TABE® Results to Inform Instruction
Trinity Catholic School is to teach the Catholic faith
Psychological Testing
Presentation transcript:

The Normal Distribution and Norm-Referenced Testing Norm-referenced tests compare students with their age or grade peers. Scores on these tests are compared with the national sample to determine if a specific student scored above or below the level expected for their age or grade. When a score is significantly above or below the level expected for the age or grade, it may indicate that the student requires educational interventions.

Norm-Referenced Test Scores DERIVED SCORES Age and grade equivalent are ordinal scores Percentile rank scores Standard scores use a set mean and standard deviation Stanines represent a range of performance

Age and grade equivalents: Represent the average number of items answered correctly by students in the sample in a particular grade Do not represent the actual skill level of the item or of the student Percentile Ranks: Do not represent a numerical scale with equal intervals However are easy to interpret and explain Stanines: Represent a range of performance Are not equidistant Represent large segments of ability and are NOT precise indicators of performance Standard scores: Use a set mean and standard deviation Represent equal units Communicate a “Range of Performance” (i.e., Average, Above Average etc.)

CAUTIONS about AE & GE Age and Grade-level Equivalent scores are determined by giving a test that is developed for a particular age/grade to students in other ages/grades. For instance, test designers establish grade-equivalents for a 4th grade test by giving that same test to students who are in the 6th and the 2nd grades. The scores are often misunderstood; be careful when you interpret them with parents. If a 4th grader received a 7.0 grade equivalent score on a 4th grade reading achievement test, the parents may believe their child is ready for 7th grade material. Actually, the score means that the child reads 4th grade material as well as the average 7th grader.

Percentile Ranks -Scores that express the percentage of students who scored as well as or lower than a given student’s score. A student received a percentile rank of 75 on a recent statewide exam. What does the 75 mean? This indicates that 75% of the students in the same grade or age group made the same score or a lower score. It also means that 25% of this group made the same score or higher than this student. So, you can say that this student scored as well as or better than 75% of his peers.

Standard Scores- Scores should be reported as confidence intervals (We’ll get to this soon ) Scores should be described in relation to a range of performance in which they fall

Relationship Between Types of Scores

Relationship Between Types of Scores with Performance Ranges Average Low Average High Average Below Average Above Average

Confidence Intervals Generally speaking: Confidence intervals are used to discuss students’ scores because all tests contain error (SEM) so, we can only confidently report students “observed or obtained” scores and their possible range of true scores. – That is, if a student obtained a standard score of 73 on a test, given a SEM of 3 we can estimate with 68% confidence that her true score fell somewhere between 70 and 76. Therefore, she scored in the Low Average range on the test. – See the CI handout for details about how to calculate these intervals.

Interpreting Test Scores

When Interpreting Assessment results… Always discuss the key derived scores provided by the assessment tool (often times these include: PR, Scaled Scores, Stanines, and Standard Scores) Always relate Standard Scores to performance ranges Follow test guidelines – Some tests have a unique performance scale to add detailed description about results (e.g., KeyMath has a scale of “weak, average, strong”) Include GE or AE scores if you interpret them accurately and feel confident in explaining them to other teachers and parents. Use these scores to corroborate/contrast instructional level results from CBAs Always include information about the student’s testing behaviors, error patterns, and notable performance strengths in your discussion of results When discussing specific standardized test results – Provide a brief summary of the test first – Discuss each subtests’ results – Then discuss each “Cluster” or “Composite” results – Finally discuss “Total Test” results

Sample wording to discuss scores: RAW SCORES: Amanda answered __ out of __questions correct on the Geometry subtest. PERCENTILES She scored at the __ th percentile, indicating that she performed as well as or better than ___% of the other __year old (or ___ grade) students who took this test. GRADE LEVEL EQUIVALENT The grade level equivalent score of ____ suggests that she performed as well as the average _____ grader in the ______ month of school on these test items. STANDARD SCORES and CONFIDENCE INTERVALS Amanda’s observed standard score on this subtest was (X). Using a standard error of measurement of (SEM), it is possible to say with 68% confidence that Amanda’s true standard score falls between ___ and ___. RANGE of PERFORMANCE Therefore, Amanda’s performance on this test places her in the _________ range of performance.

It would end up reading as one paragraph like this… Amanda answered 17 out of 30 questions correct on the Geometry subtest. She scored at the 59 th percentile, indicating that she performed as well as or better than 59% of the other 12-year-old students who took this test. She earned a grade level equivalent score of 6.3, which suggests that she performed as well as the average 6 th grader in the 3 rd month of school on those test items. Amanda’s observed standard score on this subtest was 102. Using a standard error of measurement of 5, it is possible to say with 68% confidence that Amanda’s true standard score falls between 63 and 73. Therefore, Amanda’s achievement on this subtest places her in the Average range of performance.

Sample Activity to practice interpreting test results… (using age norms) Discuss raw score Discuss the percentile rank. Discuss GE Discuss Standard Score Calculate a 68% confidence interval and discuss it. Discuss the range of performance. Raw score Percentile Rank GE Standard Score SEM

Sample Activity to practice interpreting test results… (using grade norms) Discuss raw score Discuss the percentile rank. Discuss GE Discuss Standard Score Calculate a 68% confidence interval and discuss it. Discuss the range of performance. Raw score Percentile Rank GE Standard Score SEM

Sample Activity to practice interpreting test results with additional scores & discussion of error patterns… (using grade norms) Raw score Percentile Rank GE Scaled Score Standard Score SEM Item- sluke student response- skul Item- saiststudent response- sat Item- tayedstudent response- tad

Now it’s your turn…