1. David Tudor OSPI Special Education Program Supervisor – Learning Improvement, Institutional Education Mini-Conference March 20, 2008

2. Discuss different types of assessments and structure of an assessment system Evaluate data to make program/instructional decisions Model effective reading and mathematics strategies

3. Assessment – process of collecting a behavior sample (data). Evaluation – process of using information to make a reasoned decision. Howell & Nolet (2000). Curriculum Based Evaluation (3 rd edition). Belmont, CA: Wadsworth/Thomas Learning

4. 1. Define your purpose 2. Define the thing to be measured 3. Devise a way to make the measured item observable 4. Conduct assessment 5. Evaluate results 6. Summarize 7. Make decisions

5. Assessments are an essential element of education used to inform instruction. (Wren 2000) Assessments provide teachers with information needed to develop appropriate lessons and improve instruction for all students, including students with disabilities (Rhodes and Shanklin,1993) Frequent assessment of developing readers, and the use of that information for planning instruction, is the most reliable way of preventing children from falling behind and staying behind (Learning First Alliance 2000, Torgesen 1998 )

6. In order to meet the higher expectations of current standards-based systems, educators need information that can be used to project how students are doing against the grade-level standards throughout the course of the year so they can determine what needs to be done to accelerate student progress toward proficiency standards. Progress monitoring techniques can provide that information (Quenomoen,R., Thurlow,M., Moen, R., Thompson,S. &Morse, A.B. 2003) Educators in effective schools consistently use reading assessments that inform and shape the instructional programs designed to help students meet established benchmarks ( Denton, Foorman, et al., 2003)

7. Reliable: A reliable measure is one that produces dependable scores. Scores are similar no matter who tests the student. Assessments close in time yield similar results. An assessment is determined to be reliable if there is a high correlation between the scores on the two times the student was tested Valid: A valid measure is an assessment that measures the trait or ability that it says it will measure

8. Fidelity refers to the degree to which components are implemented as designed, intended, and planned. Fidelity is vital in universal screening, instructional delivery and progress monitoring.

9. Formative: On-going assessments, reviews, observations in a classroom. Teachers use formative assessments to improve instructional methods and student feed back throughout the teaching and learning process. Summative: Used to evaluate the effectiveness of instructional programs and services at the end of an academic year or at a predetermined time. Measure student competency after an instructional phase is complete (example-- WASL). Summative evaluations are used to determine if students have mastered specific competencies and identify instructional areas where additional help is needed. (Florida Center on Reading Research, 2005)

10. Outcome – measure effectiveness of overall instructional program Screening / Benchmark – quick and efficient. Measure a students current achievement based on grade-level performance standards Diagnostic – define a students weaknesses and strengths with critical skills Progress Monitoring – measure of progress towards academic goals related to current instruction Informal – provide student level information, but are not standardized or normed

12. Discuss the key elements of valid and reliable assessments. What are the benefits of having an assessment system?

13. Primary users are teachers, school administrators, district level administrators, state education agencies, and policy decision makers. Measures what content and skills have been mastered. High stakes summative assessments measure program effectiveness and normative student achievement. Usually administered once a year but could also be used to measure an end of semester study unit. (K- 12 Reading Model pg. 39)

14. School staff conduct universal screening in all academic areas and behavior to all students three times/year Purpose of universal screening is to identify students at risk for academic or behavior failure Universal screening data tells us whether a child is on track compared to peer group and/or state standards The students data at benchmark testing periods can be utilized to validate the effectiveness of intervention. Is the gap closing?

15. All students are screened to determine which students are suspected to be at risk for academic and/or behavioral difficulty. Some students suspected to be at risk continue in Tier I with progress monitoring; Progress monitoring: Confirms or disproves risk (false positive)

18. http://kmnet.renlearn.com/Library/R0039794 01GG1107.pdf http://kmnet.renlearn.com/Library/R0039794 01GG1107.pdf http://kmnet.renlearn.com/Library/R0039795 01GGAA93.pdf http://kmnet.renlearn.com/Library/R0039795 01GGAA93.pdf

19. Why is it essential to administer screening assessments? What are the unique challenges faced by institutional education centers? How can institutional education centers mitigate unique challenges?

20. Primary users - teachers, students and parents Promote academic growth while students are progressing to meet standards. Measure for ongoing, specific instructional decisions based on data outcome. Includes curriculum-based assessments (CBAs), curriculum-based measures (CBMs), daily, informal observations, curriculum tasks, informal or formal tests (K- 12 Reading Model pg. 39)

21. Progress monitoring is a scientifically based practice that uses a set of standardized assessment procedures for determining the extent to which students are benefiting from classroom instruction and for monitoring effectiveness of curriculum on a regular basis. Progress monitoring can be implemented with individual students or an entire class. National Center on Student Progress Monitoring Formative assessment – process of monitoring student achievement during instruction. CBMs are primarily used as a method for progress monitoring because they are brief, easy to administer and score, and are good predictors of student ability

22. Standard assessment tools… Reliable Valid Sensitive Capacity to model growth Independent Feasible That are the same difficulty and that are… Given the same way each time.

23. Curriculum-based measurements (CBM) Original work from Deno, 1985 Establish entry-level performance relative to long term goal and note trends (How does the individual compare to the whole? Dual discrepancy) Good predictors of student achievement Have a prescribed methodology which increases validity and reliability Include systematic procedures for analyzing and summarizing information

24. Monitoring Basic Skills Progress (Pro-Ed Online, 2006); DIBELS (2006); Intervention CBM probes (Interventioncentral.org) FREE AIMSweb (2006)

25. The same kind of evaluation technology as other professions… The same kind of evaluation technology as other professions… Doctors Doctors Stock brokers Stock brokers Powerful Powerful measures that are: Simple Simple Accurate Accurate Efficient decisions Efficient indicators of student achievement that guide/inform a variety of decisions

26. Are designed to serve as indicators of general math achievement. Are designed to serve as indicators of general math achievement. Are standardized tests to be given, scored, and interpreted in a standard way. Are standardized tests to be given, scored, and interpreted in a standard way. Are researched with respect to psychometric properties to ensure accurate measures of learning. Are researched with respect to psychometric properties to ensure accurate measures of learning.

27. 27 Math probes are administered 2 to 4 minutes depending upon the Grade Level of the assessment material. Math probes are administered 2 to 4 minutes depending upon the Grade Level of the assessment material. Emphasis is placed on what students do correctly. Emphasis is placed on what students do correctly. Grade LevelTimingTest ArrangementWhat is Scored 1 - 32 minutesIndividual, small, or large group Correct digits in answer 34 minutesIndividual, small, or large group Correct digits in answer 5 -64 minutesIndividual, small, or large group Correct digits in answer or Correct digits in answer & critical process

28. Oral reading fluency (ORF) 3 minute cloze comprehension Definitions

29. Using aggregate tables activity Using the aggregate table (green sheets) in your handouts, with a partner, for Grade 5 and 6 identify: Winter benchmark levels within the 50 th -75 th % Number of students in the spring sample The ROI for the 25 th percentile ROI Formula=ROI is the spring score – fall score (or winter – fall) divided by 36 weeks (or 18 weeks, depending on the number of instructional weeks). Num = Number of students WRC = words read correctly ROI = Rate of improvement.

30. FallWinterSpring Grade %ileNum CD Num CD Num CD ROI 5 90 6944 51 7603 60 8023 730.6 754048610.6 503038490.5 252328360.4 101518250.3 Mean323949 StDv151720

31. FallWinterSpring Grade %ile NumCDNumCDNumCD ROI 6 90 2692 53 3654 69 3318 650.3 753950470.2 502737330.2 252027250.1 101421 0.2 Mean 324239 StDv2123

32. 100 95 90 85 80 75 70 65 60 55 50 45 40 35 30 25 20 15 10 5 B12345678910101 1212 1313 Words Read Correct X X X

33. 100 95 90 85 80 75 70 65 60 55 50 45 40 35 30 25 20 15 10 5 B12345678910101 1212 1313 Words Read Correct X X XX XX X X X X X X X X X X

34. New Practitioner Briefs Added to NCSPM Library! Two new practitioner briefs on website; the first is What Is Student Progress Monitoring and How Will It Help Me?What Is Student Progress Monitoring and How Will It Help Me? The second is Getting Started: How Do I Implement CBM in My School?Getting Started: How Do I Implement CBM in My School? Both briefs are geared toward administrators, but are beneficial for teachers and families as well. http://www.studentprogress.org 34

35. Would progress monitoring be effective within institutional education centers? Why or why not? What is currently in place? What needs to be added?

36. Targeted assessment means shifting to evaluations that are designed around the specific targeted concerns of the student. In other words, we select assessments that measure the area of concern rather than administering an assessment and then trying to determine what it means. http://www.k12.wa.us/CurriculumInstruct/Reading/def ault.aspx http://www.k12.wa.us/CurriculumInstruct/Reading/def ault.aspx

39. The questions that p_____ face as the raise ch________ from in_______ to adult life are not easy to an________. Both fa______ and m________ can become concerned when health problems such as co_______ arise any time after the e______ stage to later life. Experts recommend that young ch______ should have plenty of s______ and nutritious food for healthy growth. B______ and g______ should not share the same b_______ or even sleep in the same r______. They may be afraid of the d_____. - Teaching Reading in the Content Areas. 2 nd edition. Billmeyer and Barton, 1998.

40. Reading Decoding/Phonemic Awareness Fluency Vocabulary Comprehension Mathematics Low stress strategies

41. Research related to adjudicated youth is limited. DeBoer, Malmgren, Glass (November, 2006) Reading Instruction for Youth with EBD in a Juvenile Correctional Facility

42. For students with low comprehension... For students with high comprehension... For students with low fluency... Assess phonemic awareness and teach if necessary. Assess decoding and teach if necessary. Teach fluency explicitly. Teach comprehension. Work on vocabulary. Assess decoding and teach if necessary. Teach fluency explicitly. Challenge with high-level comprehension and vocabulary. For students with high fluency... Work on vocabulary. Teach comprehension. Challenge with high-level comprehension and vocabulary. Adapted from Hasbrouck & Tindal (2006) http://www.readnaturally.com/howto/whoNeeds.htm

43. Choral reading Cloze reading Speedy Syllables Assisted Reading Practice 6 Minute Solution Paired Reading

44. Morphemic Elements Affix concentration Meaningful Affixes Graphic organizers

45. Collaborative Strategic Reading (Klingner & Vaughn, 1998) Strategic Instruction Model (Deschler & Schumaker, 1988)

46. Lattice multiplication Lattice addition Skip zeroes Duplation Thoughts about Presentation Think Alouds

47. www.edhelper.com http://www.khake.com/page3.html Skills for Today website http://www.alaskachd.org/toolkit/index.html Self-determination toolkit WSECU – Vault program http://www.handsonbanking.org/ http://www.fcrr.org/ Florida Center for Reading Research http://www.k12.wa.us/assessment/WASL/SocialStudies/default.aspx OSPI reading assessment – 4 week summer school course.

48. For further information, please contact: David Tudor david.tudor@k12.wa.us (360)725-6075