Assessing Learners with Special Needs: An Applied Approach, 6e © 2009 Pearson Education, Inc. All rights reserved. Chapter 5: Introduction to Norm- Referenced Assessment

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 2 Norm-Referenced Tests Norm-referenced tests—tests developed to establish the average or typical performance of students within specific age or grade groups. When students are administered these test instruments, their performance can be compared with the typical or average performance of students of the same age or grade.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 3 Norm group—a large group of people thought to represent the population for whom the test was designed. Areas where the norm group must be representative of the larger population include: gender, ethnicity, geographical region, native language, and socioeconomic status.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 4 Test developers select an educational domain they want to assess (e.g., reading fluency, writing composition, math problem solving). A domain is an area of cognitive development or ability thought to be evidenced by certain behaviors or skills.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 5 An item pool, a large collection of test items thought to effectively represent a particular domain or content area, is compiled from various sources and scrutinized for appropriateness. An experimental version of the test, called a development version, is created and field tested for the purpose of revising before publication.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 6 Interpolation is used to obtain an average expected score for each month of the school year. Interpolation is the process of dividing existing data into smaller units for establishing tables of developmental scores. Chronological age refers to the numerical representation of a student’s age, expressed in years, months, and days.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 7 Norm-referenced tests are often administered when it is necessary to determine if the student’s ability or skill level is significantly above or below age or grade peers. For example, these tests are used to assess students who may be within the gifted range of intellectual ability or who may have significant cognitive challenges.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 8 General Guidelines for Test Administration Student requests for repetition of test items Asking students to repeat responses Student modification of responses Confirming and correcting student responses Reinforcing student work behavior

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 9 Encouraging students to respond Questioning students Coaching Administration of test items

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 10 Key Terms in Test Administration Test manual—a manual that accompanies a test instrument and contains instructions for administration and norm tables. Protocol—the response sheet or record form used by the examiner to record the student’s answers.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 11 Basal—thought to represent the level of skills below which the student would correctly answer all test items. Ceiling—thought to represent the level of skills above which all test items would be answered incorrectly; the examiner discontinues testing at this level.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 12 Development of Norm-Referenced Scores Recall that when enough data are collected on skills and abilities, those scores will be distributed in a normal distribution or bell curve. Norm-referenced tests are given to large groups of students in the age or grade groups for which the test is developed.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 13 These tests are scored and the average performance of students for each grade or age level is determined. The standard deviation is also calculated. When the test’s developers produce the tests, the scoring and comparisons are based on the performance of the standardization sample.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 14 When data are collected, the average performance by age, for example, might look like this: Age Raw Score Standard Score 100 Percentile Rank 50

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 15 The table presents the average raw scores for each age. The average raw scores are the average number of items answered correctly for each age group. Age Raw Score Standard Score 100 Percentile Rank 50

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 16 Age Raw Score Standard Score 100 Percentile Rank 50 Many test developers use the standard score scale that has a mean of 100. Therefore, 100 is used to represent average for each age on this particular test.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 17 Recall that percentile rank indicates the student’s standing or rank when compared to the age or grade group. Because these students earned the average or mean score, they also obtained a score in the middle of the distribution.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 18 Age Raw Score Standard Score 100 Percentile Rank 50 In other words, they performed as well as or better than 50% of the sample.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 19 The previous slides illustrated the average performance. Other data are used by the test developers to determine other scores and percentile ranks for students who did not perform as average.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 20 Age 7 Raw Score Standard Score Percentile Rank See the scores below for other levels of ability of 7 year olds.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 21 Age 7 Raw Score Standard Score Percentile Rank Notice that the average performance of 15 raw score points yields a standard score of 100 and the percentile rank of 50. However, students who earned only 8 raw score points received a standard score of 85 and were ranked at the 19th percentile rank.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 22 Calculating Raw Scores A raw score is the first score obtained in test administration. This score represents the number of items correct. The raw score of 8 points was determined by calculating the number of items answered correctly on a particular subtest.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved ___ ___ Raw Score = 8 In this example, each time the student answers correctly, the student receives a score of 1.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 24 Calculate the raw score for this 7 year old.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 25 JeremyAge Raw Score?

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 26 Age 7 Raw Score Standard Score Percentile Rank Look at the table below. Jeremy, who earned a raw score of 22 would receive what standard score and percentile rank? Development of Norm-Referenced Scores (cont.)

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 27 Age 7 Raw Score Standard Score Percentile Rank Refer to the bell curve illustration in chapter 3 of your text. How does this table relate to the bell curve? Can you locate the standard scores and the percentile ranks on the bell curve? What percent of students would you expect to score within 1 standard deviation unit above and below the average score (i.e. the mean)?

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 28 Scoring Norm-Referenced Tests Recall that the first score obtained on norm-referenced tests is the raw score. The raw score usually indicates the correct number of items correct when the items are scored with a point value of 1 for correct and 0 for incorrect. Some subtests have items that are scored with varying point values. For example a subtest may have items that are scored from 0-4.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 29 The example used for illustrating scoring on the next few slides includes a reading subtest with a point value of 0 for incorrect and 1 for correct. The example employs a standard score scale with a mean of 100 and a standard deviation of 10.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 30 Steps in Scoring Norm-Referenced Tests Step 1— Obtain all raw scores for all subtests administered. Step 2—Use the age or grade appropriate table in the test manual to look up the student’s standard score and percentile rank. In order to find the correct score, use the obtained Raw Score. Step 3—Locate the raw score on the table and read across to find the correct standard score and percentile rank.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 31 Reading Decoding Subtest for an 8 year old student Raw Score Step 1—Obtain Raw Scores

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 32 Raw ScoreStandard Score Percentile Rank Step 2—Use Tables to Find SSs & Percentiles

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 33 With a raw score of 9, what is the standard score? What is this percentile rank? Raw ScoreStandard ScorePercentile Rank Step 3—Locate the SS and Percentile associated with the raw score.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 34 Important Questions Remember that the standard score scale for this instrument is based on a mean of 100 and a standard deviation of 10. What does the standard score of this 8 year old mean? What does the percentile rank of this 8 year old mean? How would you explain this to the student’s parents?

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 35 Based on the scores below, can you interpret the possible strengths and weaknesses that might be indicated by these results? StandardPercentile Score Rank Reading Decoding Reading Comprehension Spelling Written Language Math Calculations 72 5 Math Application 70 4 Interpreting Strengths and Weaknesses

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 36 High Stakes Testing Group achievement tests are used to assess accountability of individual students and school systems. They are called high stakes tests because the results often have serious implications for accountability, accreditation, and funding for school systems. They are also used to make high stakes decisions about students.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 37 IDEA 2004 supports IDEA 1997’s mandate that all students with disabilities be included in statewide and district-wide accountability assessments. The majority of students with disabilities are expected to take the same assessment as their non-disabled peers, with accommodations where appropriate.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 38 Students who are not capable of taking the general assessment are required to be given an alternate assessment.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 39 Accommodations are necessary changes in format, response mode, setting, or scheduling that will enable a student with disabilities to complete the general curriculum or test. Accommodations must not alter what the test is measuring. Assistive technology (AT) (e.g., speech synthesizers, electronic readers, communication boards) is necessary technology that enables the student to participate in a free, appropriate public education.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 40 Accommodations for assessments include: The use of assistive technology Possible changes in: the format of assessment the manner in which the student responds the setting of the assessment the scheduling of the assessment.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 41 The purpose of accommodations for assessments is to prevent measuring the student’s disability and to allow a more accurate assessment of the student’s progress in the general curriculum.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 42 Alternate assessments should be designed to reflect progress in the general education curriculum at the appropriate level. The type and level of the assessment is an individualized decision. For example, a student with significant cognitive disability may not be able to master the skills expected of a 1 st or 2 nd grade student. Skills measured for this student may be pre- academic skills necessary to progress toward 1 st and 2 nd grade skills.

Assessing Learners with Special Needs: An Applied Approach, 6e Overton © 2009 Pearson Education, Inc. All Rights Reserved. 43 Universal Design—the practice of designing assessments to be more fair and user friendly for all learners from the beginning rather than attempting to fit a test to a student’s needs after it has been developed.