Setting ambitious, yet realistic goals is the first step toward ensuring that all our students are successful throughout school and become proficient adult.

Slides:



Advertisements
Similar presentations
Measuring Teacher Impact on Student Learning PEAC Discussion Document| August 20, 2010.
Advertisements

Response to Intervention (RtI) in Primary Grades
Chapter 9 Fluency Assessment Jhanyce A. Acosta. What? * Fluency Assessment -a method of listening to students read aloud in order to gathering their data,
TEKS BASED IEPs PLAAFPS GOALS & OBJECTIVES
Standards-Based IEPs Writing Goals and Objectives
Big Ideas About Frequent Formative Evaluation Using General Outcome Measures and the Progress Monitoring Program One of the most powerful interventions.
DIBELS Part I SEDL 368. To access the materials, you will need to go to Download.
Progress Monitoring project DATA Assessment Module.
Plan Evaluation/Progress Monitoring Problem Identification What is the problem? Problem Analysis Why is it happening? Progress Monitoring Did it work?
Extending RTI to School-wide Behavior Support Rob Horner University of Oregon
APS Teacher Evaluation A SMART Process for Student and Teacher Growth.
Thinking Smart About Assessment Ben Clarke, Ph.D. Rachell Katz, Ph.D. August 25, 2004 Oregon Reading First Mentor Coach Training © 2004 by the Oregon Reading.
1 Meeting the Needs of Some and High Risk Readers Oregon Reading First Outreach November 7, 2008 Jerry Silbert, Reading Consultant Elizabeth Jankowski,
Oregon Reading First (2010)1 Oregon Reading First Regional Coaches’ Meeting May 13, 2010.
Oregon Reading First (2009)1 Oregon Reading First Regional Coaches’ Meeting May 2009.
1 Project-wide Reading Results: Interpreting Student Performance Data and Designing Instructional Interventions Oregon Reading First February, 2004 Institute.
Reading First Assessment Faculty Presentation. Fundamental Discoveries About How Children Learn to Read 1.Children who enter first grade weak in phonemic.
Leader & Teacher SLTs 2014 – ComponentEvaluation for TeachersEvaluation for School Leaders Setting GoalsTeachers set two SLTs in collaboration with.
Chapter 9 Fluency Assessment Tina Jensen. What? Fluency Assessment Consists of listening to students read aloud for a given time to collect information.
Cohort 5 Elementary School Data Review and Action Planning: Schoolwide Reading Spring
STANDARDS BASED GOALS and OBJECTIVES
Authentic Assessment Principles & Methods
The difference between learning goals and activities
DATA BASED DECISION MAKING IN THE RTI PROCESS: WEBINAR #2 SETTING GOALS & INSTRUCTION FOR THE GRADE Edward S. Shapiro, Ph.D. Director, Center for Promoting.
100 % Data Meetings 100% Data Meetings turn data into ACTION FOR ALL students.
Response to Intervention RTI Data Challenge: Setting Individual RTI Academic Goals Using Research Norms for Students Receiving.
California Mini-CorpsOctober 10, Writing SMART Goals In order to become a team – a group of people working interdependently to achieve a common.
Curriculum and Learning Omaha Public Schools
Comp 20 - Training & Instructional Design Unit 6 - Assessment This material was developed by Columbia University, funded by the Department of Health and.
School Improvement Planning Today’s Session Review the purpose of SI planning Review the components of SI plans Discuss changes to SI planning.
School-wide Data Analysis Oregon RtI Spring Conference May 9 th 2012.
Harry Wong Says Procedures are the Way to Go… Response to Intervention is a procedure-based system. It is also a problem solving system. Something isn’t.
B-ELL Leadership Session May 26, 2009 Jorge Preciado University of Oregon © 2009 by the Oregon Reading First Center Center on Teaching and Learning.
Student Learning Objectives: Approval Criteria and Data Tracking September 17, 2013 This presentation contains copyrighted material used under the educational.
Adolescent Literacy – Professional Development
Using Data in the EBIS System Universal Screening and Progress Monitoring.
Professional Learning Communities “The most promising strategy for sustained, substantial school improvement is developing the ability of school personnel.
Instructional Decision Making in Iowa IOWA. Iowa’s Experience: How it all started Began in Discussions with stakeholders Parents Teachers Administrators.
Student Growth Measures in Teacher Evaluation Using Data to Inform Growth Targets and Submitting Your SLO 1.
STUDENT GROWTH UPDATE LEARNING GOALS FOR TODAY - Teachers will be able to clearly delineate between the 4 levels of expectations on student.
PREPARING [DISTRICT NAME] STUDENTS FOR COLLEGE & CAREER Setting a New Baseline for Success.
Keystone Educational Consulting Dr. Ashlea Rineer-Hershey Dr. Richael Barger-Anderson.
AN ANALYSIS OF THE EFFECTIVENESS OF THE EARLY READING INTERVENTION FOR SELF-EFFICACY (E-RISE) ON FIRST, SECOND, AND THIRD GRADE STUDENTS IN AN AT-RISK.
Class Action Research: Treatment for the Nonresponsive Student IL510 Kim Vivanco July 15, 2009
Summative vs. Formative Assessment. What Is Formative Assessment? Formative assessment is a systematic process to continuously gather evidence about learning.
Assessment Information from multiple sources that describes a student’s level of achievement Used to make educational decisions about students Gives feedback.
Data Analysis Processes: Cause and Effect Linking Data Analysis Processes to Teacher Evaluation Name of School.
Gathering Evidence to Achieve Results.  ALL CSD students and educators are part of ONE proactive educational system.  Evidence-based instruction and.
Changes in Professional licensure Teacher evaluation system Training at Coastal Carolina University.
A Look at Repeated Readings. Agenda What is repeated readings? Why is repeated readings effective? What does the supporting research for repeated readings.
Primary Assessment and Target Tracker
Life without Levels Assessing children without levels.
Gathering Evidence to Achieve Results. A Culture of Collaboration - PLC Norms - Systems Support A Focus on Results -Pre-assessments -Common Formative.
The State of Our School Fall, Goals What do we want all children to know and be able to do with text in our school? K – 90% of students will reach.
Performance Monitoring COURTNEY MILLS SCPCSD DIRECTOR OF ACADEMIC PROGRAMS.
21 st Century Learning and Instruction Session 2: Balanced Assessment.
Learning AP ILD November 8, 2012 Planning and Monitoring for Learning.
Progress Monitoring Goal Setting Overview of Measures Keith Drieberg, Director of Psychological Services John Oliveri, School Psychologist Cathleen Geraghty,
Intensive Reading Support 6.0 Evaluate Instructional Support 21.
The State of the School’s Reading First Program Fall, 2005.
1 Teacher Evaluation Institute July 23, 2013 Roanoke Virginia Department of Education Division of Teacher Education and Licensure.
Good Morning and welcome. Thank you for attending this meeting to discuss assessment of learning, pupil progress and end of year school reports.
K-5: Progress Monitoring JANUARY, 2010 WAKE COUNTY PUBLIC SCHOOL SYSTEM INTERVENTION ALIGNMENT.
Data Collection Challenge:
Standards-based Grading and Reporting
Reading Goals and Reading Growth A Proposal for Cohort A
Overview: Understanding and Building a Schoolwide Assessment Plan
Extending RTI to School-wide Behavior Support
Reading Goals and Reading Growth A Proposal for Cohort A
Identifying Multiple Measures and Defining Significance
Presentation transcript:

Setting ambitious, yet realistic goals is the first step toward ensuring that all our students are successful throughout school and become proficient adult readers. High expectations should be established for all students. To quote Henry Ford, “whether you think you can or you think you can’t… you’re right!” 1

The importance of setting student outcome goals in reading: Goals represent desired outcomes or targets toward which to strive. Goals shape our instructional effort and guide us toward our intended outcomes. Attainment of strong reading goals makes future school success more likely. Failure to attain reading goals puts students at- risk for future struggles in both school and work. More specifically, setting student outcome goals in reading is important for the following reasons: Goals represent desired outcomes or targets toward which the students and schools can constantly strive. Goals shape our instructional effort and guide us toward our intended outcomes. Attainment of strong reading goals makes future school success more likely. And, failure to attain reading goals puts students at-risk for future problems and struggles in both school and the workplace.

Types of student reading goals: Summative and Formative Goals Summative goals address reading outcomes: All students will read at grade level or higher each year, no later than grade 3, as measured by the OAKS assessment. All students in grades 4-12 will be proficient readers of grade level content across the instructional areas. There are two types of student reading goals: Summative goals and Formative goals. This module focuses on summative reading goals. Summative goals address reading outcomes. For example, the Oregon K-12 Literacy Framework sets these broad summative goals: All students will read at grade level or higher each year, no later than grade 3, as measured by the OAKS assessment. All students in grades 4 through 12 will be proficient readers of grade level content across the instructional areas.

Types of student reading goals: Summative and Formative Goals (continued) Formative goals address progress toward the longer term goal of reading at grade level or above: Formative goals should be set for the skills that need to be achieved by a certain point in time (e.g., by the end of a grade). Thus, formative goals and the benchmarks that define them will differ by grade. Formative goals address progress toward the long-term goal of reading at grade level or above. Such goals should be set for the skills that must be achieved by a certain point in time (for example, by the end of a grade). Formative goals, and the benchmarks which define them, differ by grade level but are applicable across grades.

Clear goals include… Who (e.g., a group of students at a given grade level) Will do what score at a given level or above on an achievement measure make a certain amount of progress over previous period At what level (level of achievement or amount of progress should be clearly stated) By when (usually by the end of the school year) Including each of these components in a goal statement operationally defines the goal and makes it easier to measure progress toward its attainment. It is crucially important that goals be clearly specified. Such clear goals include who; will do what; at what level; and by when.

Examples of clear goals: At the spring benchmark assessment, all kindergarten students will be able to read randomly- presented CVC pseudo-words at a rate of 25 correctly-produced letter sounds per minute. In the fall of grade 2, all students will be able to orally read grade-level text at a rate of 44 correctly- read words per minute. At the spring screening assessment, grade 6 students will be able to orally read grade-level text at the rate of 160 correctly-read words per minute. Some examples of clear goals include… At the spring benchmark assessment, all kindergarten students will be able to read randomly-presented CVC pseudo-words at a rate of 25 correctly-produced phonemic segments per minute. In the fall of grade 2, all students will be able to orally read grade-level text at a rate of 44 correctly-read words per minute. At the spring screening assessment, grade 6 students will be able to orally read grade-level text at the rate of 160 correctly-read words per minute.

“Strong” Goals Goals are “mission-focused” (not trivial). Goals are derived from the school’s vision for success. Goals focus on valued outcomes (not just processes). Goals are prioritized and remain in focus over time. Goals should be “strong” as well as clear. In other words, they should be “mission-focused” derived from the school’s vision for success, focused on valued outcomes, prioritized and kept clearly in focus over time.

“Strong” Goals (continued) Ambitious, yet attainable Clearly defined and measureable Easily understood and transparent to all stakeholders Differentiated Grade level differences in goal-setting Student’s varying skill levels in goal-setting School-wide similarities in goal-setting Strong goals must be ambitious, yet attainable. For example, the stated goal may be to bring all students to grade level by third grade, but we also need to take into consideration students’ current instructional levels. How to handle individual students’ situations will be addressed later in the presentation. Goals should be clearly defined and measureable so that the goal itself, progress toward the goal, and the criteria for goal attainment are clear. Goals should be easily understood and transparent to all stakeholders (since stakeholders should be involved and/or holding educators accountable for goal attainment). And finally, goals should be differentiated. There should be different goals for different grades, but with cohesiveness and similarity of goal purpose throughout the school.

Student reading goals should be based on one or more of the following: Norms on a measure of reading achievement Criteria or benchmark scores Progress made toward a standard (e.g., AYP) Level reached by a higher-performing group of students with comparable demographics Curriculum content mastered (curriculum maps) Student reading goals should be based on one or more of the following: Norms on a measure of reading achievement; the criteria or benchmark scores; progress made toward a standard (for example, Adequate Yearly Progress); the level reached by a higher-performing group of students with comparable demographics; and what curriculum content is to be mastered (most evident when curriculum maps are used).

Basis for outcome goals by grade spans Grades K-2: Standardized achievement test (if used) Progress monitoring measure (if test not used) % of students at benchmark levels % of students demonstrating mastery on skills from reading curriculum map Grades 3-12: Standardized achievement test The foundation for goals will vary a little across the grades. Using the goals specified in the Oregon K-12 Literacy Framework as an example: In Kindergarten through 2nd grade, goals will most likely be based on a standardized achievement test (if used), or a progress monitoring measure. For example, the percent of students performing at benchmark levels or percent of students demonstrating mastery on skills from reading curriculum maps. In 3rd through 12th grade, goals will mostly likely be based on a standardized achievement test.

Sample Curriculum Map This is a sample curriculum map for second grade students. Component reading skills for the alphabetic principle appear on the left. Time appears across the top. An X represents that skill being covered during that time. A number or range represents the target performance (in the case of 4a) or minutes of practice per day (in the case of 4c).

Sample Progress Monitoring This is a sample progress monitoring graph. Again, time appears on the horizontal axis and score on a given measure appears on the y-axis.

Sample Benchmark Goals Second Grade DIBELS Benchmark Goals (DIBELS 6th edition) Second Grade DIBELS Benchmark Goals DIBELS Measures Beginning of Year (BOY) Middle of Year (MOY) End of Year (EOY) Performance Status Oral Reading Fluency ORF < 26 At Risk ORF < 52 ORF < 70 26 < ORF < 44 Some Risk 52 < ORF < 68 70 < ORF < 90 ORF > 44 Low Risk ORF > 66 ORF > 90 These are sample benchmark goals for second grade DIBELS. There are separate columns for each time point - beginning, middle, and end of the year. Rows represent measures. For each time point, a range of scores is associated with at-risk, some-risk, and low-risk status.

Setting goals for achievement levels vs. achievement growth Achievement levels may differ from school to school as a function of “academic challenges.” However… Achievement growth should not be be limited or excused by academic challenges. All students can reach ambitious reading goals. An important thing to keep in mind while setting goals is the difference between achievement level and achievement growth. Achievement levels may differ from school to school as a function of “academic challenges” (or barriers to achievement related to demographic characteristics, such as poverty and language differences). However, achievement growth should not be limited or excused by academic challenges. As educators we must work around – and with – academic challenges in order to help students grow into skilled readers. We must carefully develop and deliver a program of reading instruction that addresses and overcomes academic challenges, so that all our students do grow impressively and reach ambitious reading goals.

Setting Goals at the Beginning of the Year Outcome Goals Adequate Progress Goals For each grade level For each group (e.g., “some-risk students”) Progress Monitoring Goals For individual students Goal setting is an important component of any successful reading program. To quote author Gertrude Stein, "You have to know what you want to get it.” There are many questions to consider when setting goals. For example: Where do we want all students to be by the end of the year? In other words, what kind of outcomes are we working toward? What are our goals for adequate progress? For example, we might answer the questions, “What percentage of our some risk students can we move to proficiency by the end of the year . . . by mid-year . . . in the first quarter?” We should think about these questions at both the grade level and the group level. What types of progress monitoring goals are appropriate? For whom do we set individual goals regarding progress? What should these goals be? We will discuss these three main types of goals in upcoming slides. You have to know what you want to get it. -Gertrude Stein 15

Setting Goals at the Beginning of the Year Outcome Goals Summative Adequate Progress Goals Summative (if at end of year) Formative (if during year) Progress Monitoring Goals Formative Keep in mind that outcome goals are always summative, adequate progress goals are either summative or formative (depending on the time at which progress is examined), and progress monitoring goals are always formative. 16

Outcome Goals Schoolwide (not individual) goals Outcome measurements vary from state to state. Outcome goals are generally established by minimum state expectations. Outcomes measured by performance relative to normative or criterion standards. Outcome goals should be set for all skills considered critical for each grade level. Outcome goals (or summative goals) are determined for the school as a whole. Outcome measures are chosen at the state-level, thus they vary from state to state. For example, some states use non-state specific outcome measurements, such as the Iowa Tests of Basic Skills, whereas others use state-developed tests such as the FCAT in Florida, the TEKS in Texas, and the Idaho Standardized Achievement Test in Idaho. Generally, minimum outcome goals are set by individual states. These goals are often connected to Adequate Yearly Progress goals established in each state. However, many schools set goals which go beyond the minimum targets established within states. Outcome measures assess performance against either normative standards (which is the student's position relative to others in the same group) or criteria (which scores are determined according to specific predetermined criteria). At a schoolwide level, summative goals should be set for all skills considered essential for each grade level. 17

Adequate Progress Goals Schoolwide (not individual) goals “Adequate Progress” is a term used to describe groups of students’ progress along the achievement continuum. Goals can be set for each grade level and for each level of student status at the beginning of the school year (grade level, some-risk, high-risk). Adequate Progress goals are also determined for the school as a whole. Again, these goals may be summative (if progress by the end of the year is measured), or formative (if progress to some interim point is measured). The term “Adequate Progress” is used to describe groups of students’ progress along the achievement continuum. By achievement continuum, we mean moving from High Risk or Some Risk status to Grade Level. Obviously, we want Grade Level students to remain at grade level throughout the school year. Adequate progress goals can be set for each grade level and for each performance level (Grade Level students, Some Risk students, and High Risk students). 18

Progress Monitoring Goals For grade level and some-risk students: Schoolwide goals are set once group performance is compared to school standards as well as established benchmark scores. Progress Monitoring Goals are set at both the school level and the student level, as needed. These are formative measures and are addressed more fully in Module 2. For Grade Level students and Some Risk students, decisions are made at a schoolwide level based on the progress monitoring screener. Goals are set by comparing student performance to school standards and established grade level expectations. 19

Progress Monitoring Goals cont’d. For High-Risk Students: Individual goals are set. Grades K and 1 Set goals to achieve “Grade Level” status. Grades 2 and 3 If Grade Level status is not reasonably attainable, set goal to move to “Some-Risk” status at student’s grade level at the end of the year. For High-Risk students, in contrast, individual goal-setting occurs and this should be done carefully and thoughtfully. For students in kindergarten and first grade, the recommendation is to set goals to achieve grade level status. Research shows that it is very difficult for students to “catch up” with peers if these students leave first grade with a High-Risk status. Therefore, all attempts should be made to see that grade level goals are met for first grade High-Risk students. Depending on the significance of the skill gaps, it may not be reasonable to set a goal of grade level proficiency for students in grades 2 and 3. Perhaps an ambitious yet realistic goal for these students is to move from High-Risk to Some-Risk by the end of the year. If this goal is met, the goal the following year for these previously-High-Risk students would be to achieve Grade Level status. Note that for both groups of students, this would mean setting a trajectory (or “goal line” as we’ll discuss next) that would decrease the gap with typical peers. 20

Setting Progress Monitoring Goals 3rd Grade Example Established Benchmark Goal 120 100 80 60 40 20 Average Peers Goal Line Option 2 - High Risk Student Words Correct Per Minute Option 1 - High Risk Student This slide depicts a couple of different scenarios when considering setting a goal for a high-risk student. Words read correctly per minute appears on the y-axis. Time appears on the x-axis. First, notice the baseline data, a goal, and a goal line for average peers at a third grade level. This information would have been obtained by collecting an average of student scores (baseline) and looking at the established benchmark goal at the end of the school year for whatever progress monitoring assessment a school is using. In this case, the benchmark goal for third grade students with this assessment is 110 words per minute, and the baseline is 75 words per minute.   Suppose a student enters third grade with a baseline median of 38 words per minute, and an appropriate goal has to be determined. Research shows that a typical student in third grade gains approximately one word per week in reading fluency. If we applied this average-gain goal-setting option to our High-Risk student, it would mean that his end-of-year goal would be 74 wpm. This number was calculated by adding the baseline 38 wpm and the 36 weeks in the school year. Option 1 indicates the resulting goal line for this student. But, examining these two goal lines reveals something problematic about this particular High-Risk student’s goal. The problem is that this goal (Option 1) does not decrease the gap with peers and so the student remains at High-Risk at the end of the year according to the fluency benchmarks on this assessment. In order for High-Risk students to make adequate progress, they must move to at least the Some-Risk status at the end of the school year. For this particular assessment the Some-Risk status at the end of the year is at least 80 wpm. Grade level status would be at least 110 wpm, but this goal may not be realistic for this student. Given the information we have, one option would be to select 90 wpm as the student’s end-of-year goal. This number would move the student above the 80 wpm threshold into the Some-Risk category. Option 2 indicates this alternative goal line. Whether one considers the numbers or visually examines the Average and Option 2 goal lines, it is clear this student will have somewhat closed the gap with grade level peers, although the grade level benchmark (110 wpm) has not yet been met. There is no one magic formula for setting goals for High-Risk students. What we’ve illustrated here is the type of detailed thinking process that should be used when setting High-Risk students’ goals. X X X Baseline Sept Oct Nov Dec Jan Feb Mar Apr May 21

Collaboration Engage stakeholders as you set goals and as you work to attain those goals. Setting goals can be a long, complex process involving many revisions. It works best as a collaborative effort. As outlined throughout the Oregon K-12 Literacy Framework and in Modules 55 and 56, those who have a vested interest in reading instruction and students’ reading achievement should be involved from the start of the school year or from the moment a schoolwide reading plan is conceived. Make it a priority to engage stakeholders both as you set goals and as you work to attain those goals.

Engaging stakeholders in setting, working toward, and attaining goals: Identify stakeholders. Identify messages and needs. Decide on communication methods and schedule. Deliver your messages and solicit involvement and feedback. Be responsive to stakeholder’s interest, questions, and suggestions. To engage stakeholders in setting, working toward, and attaining goals, you can… Identify all groups with a stake in reading outcomes. Identify the messages you want to send and the needs you have. Decide the ways in which you can best communicate with the stakeholders and the schedule for those communications. Deliver your messages on the schedule you’ve laid out, and solicit involvement and feedback as needed – both on results and on the schedule itself. And, be responsive to stakeholder’s interest, questions, and suggestions.

Conclusion “Students able to read at grade level or higher are likely to accomplish key learning objectives in grades K-12. They are more likely to learn successfully in their classes, and they are more likely to perform well on state assessments that test how well students understand the content of the state standards. Formative goals provide valuable information about whether students are on track to meet the summative goal. When students have not met a formative reading goal, it is critical that schools use that information to improve reading instruction.” (OLF, pg. G-12) Goals are something for students to strive for, but they are also a means for schools to evaluate instruction and make changes that will help students succeed. Goals motivate students to learn, but give schools something to learn from. In closing, please consider these words from the Oregon K-12 Literacy Framework’s section on goals: “students able to read at grade level or higher are likely to accomplish key learning objectives in grades K-12. They are more likely to learn successfully in their classes, and they are more likely to perform well on state assessments that test how well students understand the content of the state standards. Formative goals provide valuable information about whether students are on track to meet the summative goal. When students have not met a formative reading goal, it is critical that schools use that information to improve reading instruction.” Goals are something for students to strive for, but they are also a means for schools to evaluate instruction and make important changes that will help students succeed. In other words, goals both motivate students to learn and give schools something to learn from.