Presentation on theme: "Student Growth Objectives Setting SGOs and Developing High Quality Assessments 2013-14."— Presentation transcript:
1 Student Growth Objectives Setting SGOs and Developing High Quality Assessments
2 Objectives for TodayExplain how SGOs can be an effective measure of student learningAnalyze the components of a well-formulated SGODetermine the assessments that would be appropriate for SGOsEvaluate the quality of pre-existing assessmentsDevelop a series of next steps to take back to your districts
3 Norms for TodayBe mindful of your normal speaking patterns Remain engaged in the process Assume good faith
4 Determining Starting Points In your table groups do the following:Briefly introduce yourselves to each other.Discuss the hopes and fears you have about SGOs.Each team write one hope and one fear - 5 word limit for each.Share your hopes and fears with the larger group.
7 Teacher ChecklistIndividually, check the items that effective teachers do in your school.Teach a curriculum that is aligned to standards.Determine the needs of students using several methods including a variety of assessments.Differentiate instruction based on the needs of students.Set goals for students appropriate to their grade, subject, and readiness level.Use high quality assessments to measure student performance.Work in collaborative groups to improve student achievement.Workshop packet pg. 4
8 In Requiring Teachers to Develop SGOs, What Are We Asking Them To Do? Teach a curriculum that is aligned to standards.Determine the needs of students using several methods including a variety of assessments.Differentiate instruction based on the needs of students.Set goals for students appropriate to their grade, subject, and readiness level.Use high quality assessments to measure student performance.Work in collaborative groups to improve student achievement.Formalize and document the process, and be recognized for doing these things well.Workshop packet pg. 4
9 8. State regulations require all of the following for SGOs EXCEPT: a) They must be specific and measurableb) They must measure learning between two points in timec) They must be aligned to standardsd) They must be perfectThis slide and those similar to it refer to the questions on the pre-survey. This survey can be modified and given to your staff as you see fit and the results used to adjust the workshop. Alternatively, you may delete this slide and the others that refer to the survey for a workshop tailored to your district’s needs. The survey can be found here - https://docs.google.com/forms/d/12ollezfuVN0Vm58BkTe9j2V8vosIgPpoJtg3JvPGm9k/viewformSurvey - Question 8
10 What is an SGO?A Student Growth Objective is a long-term academic goal that teachers set for groups of students and must be:Specific and measureableAligned to New Jersey’s curriculum standardsBased on available prior student learning dataA measure of student learning between two points in timeSGO Guidebook pg. 3
11 What Constitutes “Growth” In Student Growth Objectives For the purposes of SGOs, the Department is defining “growth” as an increase in learning between two points in time, such as that indicated by:Acquisition of knowledge or skill from a particular starting point or readiness level.Development of a portfolio indicating a change in skill or knowledge over a period of time.Difference in learning on pre- and post-tests.Psychometricians use the term growth in a very specific way and develop assessments with valid and reliable constructs to measure it. Unless the teacher has access to such a set of assessments, technically, they cannot measure “growth” of the their students.However, using the term growth more loosely is appropriate for the purposes of SGOs, and can include any of the above examples, e.g. target score of 80% based on rigor of assessment and readiness level of students, improvement by 3 reading levels on DRA test, increase on post test by 50% compared to pre-test, increase in score by one level on a portfolio rubric in at least 70% of elements.
12 1. For what percentage does the SGO rating count towards a teacher’s evaluation? b) 15c) 20d) 15 for teachers in non-tested grades and subjects and 20 for teachers with an SGPSurvey - Question 1
14 2. How many SGOs must a teacher set for evaluation? a) All set only 1b) All set only 2c) All set between 1 and 2, depending on district discretiond) 1 or 2 for teachers with SGPs, 2 for teachers in non-tested grades and subjectsSurvey - Question 2
15 SGOs in AchieveNJ - Requirements All teachers who receive an SGP score must set between 1 and 2 SGOs.Teachers who do not receive an SGP score must set 2 SGOs.A teacher develops SGOs in consultation with his or her principal.SGOs must be aligned to NJCCCS or CCSS and measure student achievement and/or growth between two points in time.SGOs must be specific and measurable and based on students’ prior learning data when available.A teachers final SGO rating is determined by the principal.SGO Guidebook pg. 5Survey - Questions 2, 4
16 SGOs in AchieveNJ - Recommendations The remainder of this workshop provides recommendations and useful guidance on how to go about making the SGO process valuable for educators and students.
17 Attributes of SGOs and SGO Development Teacher-createdTailoredCollaborativeProcess-basedFlexible
18 Distinguish Between General and Specific SGOs Working in your district groups, and using the examples provided, determine the attributes that distinguish a general SGO from a specific SGO.Share your answers with your table group.SGO Guidebook pg. 5-7Workshop packet pg. 5
19 General or Specific SGOs Example 2: A music teacher teaches two sections of orchestra, two sections of guitar, and one of strings. He sets one of his SGOs for orchestra, and one for guitar, thereby including the majority of his students. His assessments are portfolio-based and include components from each of the four visual and performing arts standards. Example 3: A kindergarten teacher has 14 students and uses a locally-developed portfolio to assess her students. She sets one of her SGOs for all of her students based on their growth as measured by 5 out of 7 domains in the portfolio.
20 General or Specific SGOs Example 1: A 4th-grade elementary team focuses an SGO on science. In consultation with the middle school science teacher, the team develops a portfolio assessment that requires the students to demonstrate the critical standards-based skill of scientific thinking and practice. Each teacher sets an SGO for her individual class based on the starting point of her students. Students build a science portfolio throughout the year. At the end of the year, the team sits together to collaboratively grade the portfolios using a rubric.
21 General or Specific SGOs SGOs can be classified as “general” or “specific.” However, in some cases, the line between these is blurry. It is better to think of general and specific SGOs being on a continuum.General SpecificBroadIncludes a significant proportion of the curriculum and key standards for a given courseIncludes all, or a significant number, of a teacher’s studentsFocusedIncludes a particular subgroup of a teacher’s students, and/orIncludes specific content or skill
22 General or Specific SGOs General SpecificA 10th-grade social studies teacher has five sections of US History 1 and has 102 students. His general SGO includes all 102 students, and incorporates a significant proportion of content standards and skills he will teach between October 15 and May 1, the week before the department-wide assessment.A 10th-grade social studies teacher finds on the free response portion of the pre-assessment many students were unable to clearly use evidence to support their points of view. He sets one of his SGOs to deal with this particular skill.
23 3. When should SGOs be set?a) Annually, before the beginning of the school yearb) Annually, during the first few weeks of the school yearc) Annually, at some point during the year at the teacher’s discretiond) Once, at the beginning of the school year to be used over the next few yearsSurvey - Question 3
24 The SGO Process Consult with evaluator to approve SGOs TeachersRecommendedOfficial SGO processConsult with evaluator to approve SGOsConsult with evaluator to discuss SGO ratingStep 1: Choose an assessmentStep 4: Track progress, refine instructionSeptember By Nov. 15* By Feb By end of school yearImportant PointSGOs can only be set in the first few weeks of the school year once baseline data has been collected. BUT preparatory work can be done before then in terms of assessments and the outline of what your SGO might look like.Step 2: Determine students’ starting pointsStep 3:Set SGOAdjustments made to SGOs with approvalStep 5: Review results and score*For 2013–14 only. In subsequent years, SGOs must be set by Oct. 15.Survey - Question 3
25 SGOs Require a Teacher to SGOs and SMART goalsTypical Usageof SMARTSGOs Must BeSGOs Require a Teacher toSSpecificDescribe how many students learn “what” or grow by “how much”MMeasurableCompare starting points to ending points using assessments of some typeAAchievableAmbitious but AchievableDetermine a reasonable amount of growth according to knowledge of studentsRRelevantAlign SGOs to standardsTTime-relatedSet an appropriate instructional periodWorkshop packet pg. 6
26 Grade:SubjectNumber of StudentsInterval of InstructionFull yearSemester Other ________Name of AssessmentSGO TypeGeneralSpecificRationale for Student Growth Objective(Please include content standards covered and explanation of assessment method.)Student Growth ObjectiveBaseline Data(Please include what you know about your students’ performance/skills/achievement levels at the beginning of the year, as well as any additional student data or background information used in setting your objective.)Scoring PlanObjective Attainment Based on Percent and Number of Students Achieving Target ScoreTarget ScoreExceptional (4)Full (3)Partial (2)Insufficient (1)
27 SGO Guidebook pg.17 Workshop packet pg. 7 Grade: Subject Number of StudentsInterval of Instruction9Physics 165Full yearSemester Other ________Name of AssessmentDepartment-developed Physics 1 assessmentSGO TypeGeneralSpecificRationale for Student Growth Objective(Please include content standards covered and explanation of assessment method.)This SGO covers all of my students, all of the physical science standards that are part of NJ standards related to physics and many appropriate science practice standards:NJCCCS physical science D-ENJCCCS science practices A-D (as appropriate)Physics 1 assessment –Written: 60 multiple choice (4 choice), 5 short response questions,Practical: students design a simple apparatus, take measurements and collect data.Student Growth ObjectiveAt least 70% (45/65) of my students will attain a score of 80% or above on the end of course test.Baseline Data(Please include what you know about your students’ performance/skills/achievement levels at the beginning of the year, as well as any additional student data or background information used in setting your objective.)Grade 8 math scores, grade 8 science scores, scores on department-developed Physics 1 pre-assessment. A summary of this data is attached. Average score on the physics pre-assessment was 52%.SGO Guidebook pg.17Workshop packet pg. 7
28 How SMART is your SGO? In your district teams, study the SGO provided. Using the SMART framework, annotate this SGO to identify which components align with a S-M-A-R-T goal.Share your findings with the group.
30 A Tiered SGOBaseline Data and Preparedness Groupings(Please include the number of students in each preparedness group. Summarize the information you used to produce these groupings. Provide any additional student data or background information used in setting your objective.)Based on the Physics 1 pre-assessment, students are grouped into 3 levels of preparedness. These groupings are also supported by prior year’s math scores. See attached.Low – 36 students scored 35-49%Medium – 21 students scored 50-66%High – 8 students scored 67-80%Student Growth ObjectivePreparedness Group(e.g. Low, Medium, High)Number of Students in Each Group (Total)Target Score on Post-Assessment (%)Number of Students Required for “Full Attainment”Low36/657025-30Medium21/658015-18High8/65906-7SGO Guidebook pg. 19Workshop packet pg. 8
32 5 Steps of the SGO Process Step 1 Choose or develop a quality assessment aligned to NJCCCS or CCSS. Step 2 Determine students’ starting points. Step 3 Set ambitious and achievable SGOs with the approval of the principal. Step 4 Track progress, refine instruction. Step 5 Review results and score in consultation with your principal/supervisor.Some detail on each of these steps can be found in the SGO Quick Start GuideSGO Guidebook pg. 8Survey - Question 9
33 Step 1 – Choose or Develop a Quality Assessment 3 components Assessment ScopeDetermine the instructional period, the appropriate standards, and the educational goals that will be captured by the assessment.Assessment QualityChoose or develop an assessment, analyze for quality, and modify as necessary.Collection of EvidenceEnsure that scoring and administration of school-based assessments relies on valid, reliable, and practical systems.SGO Guidebook pg. 10
34 Assessment Scope Planning Determine the instructional period, the appropriate standards, and the educational goals that will be captured by the assessment.In your district teams, complete the planning guide.Make note of the questions that you were able to answer easily and those that provided more of a challenge.Share your findings with your table group.Workshop packet pg. 9
35 Assessment Scope Planning So that data can be available for annual conferences, October to early May would be a good instructional window. However, June is fine as long as it gives administrators long enough to do the annual conferences.For teachers of semester courses, two options are open to them:1) Set 2 SGOs for students in the first semester using baseline data collected at the beginning of the school year. Teachers should begin teaching curriculum associated with this goal as soon as practical, perhaps by the end of September. They should not have to wait until the November 15 deadline to begin this – this would produce a very short instructional window and not be a fair representation of the scope of the teacher’s work. However, the November 15th deadline will give teachers and administrators a date by which any modifications to the SGO could be made based on the first couple of months of school. By this date, the scoring plan should be set firmly and will be used to evaluate the teacher.2) Set 1 SGO for the first semester and 1 for the second. Follow the procedure in (1) for the first semester SGO. For the second semester SGO, even though a rough outline of the SGO should be developed and the assessment chosen by November 15th, baseline data may not be available. Therefore, teachers may not be able to confidently develop a scoring plan and finalize their SGOs until the beginning of the second semester. The February 15th mid-year adjustment date provides an opportunity for teachers to make adjustments to the SGOs they officially set by the November 15th deadline. These adjustments will be made using the baseline data they are able to collect at the beginning of the second semester course.Even though both options are allowed under the new evaluation system, the second option may provide a fairer and more accurate picture of an educator’s work. It spans a whole year and more of the students for whom that teacher is responsible. It is closer to the spirit of the SGO process that we would like to see districts aim for.Note – this form is not in the SGO guidebook but will be in the next version.Workshop packet pg. 9
36 Assessment Scope What do you want your students to KNOW?
37 Assessment Scope What do you want your students to DO?
38 Assessment Scope Critical Decisions About Critical Standards In district teams, review the social studies standards provided.Which standards are foundational for success in this class and beyond?Which standards will lead to enduring understanding?Which of these standards will be taught during the SGO instructional period?Identify a group of standards that fit these criteria and write them on the Standards Alignment and Coverage form.Share your findings with your table group.
40 Assessment Quality Types of Assessments Choose or develop an assessment, analyze for quality, and modify as necessary.3 OptionsPurchase a new assessment or select an existing oneCreate a new assessment locallyModify an existing assessment
41 Assessment Quality Types of Assessments Traditional AssessmentsPortfolioAssessmentsPerformance AssessmentDistrict, school and departmental tests e.g., modified final exams, benchmark examsState and national exams (except the NJ ASK), e.g. NOCTI, APWriting and reflection sampleLaboratory research notebookPortfolio of workProject-based assessmentTeaching Strategies Gold®Lab PracticumSight reading in musicDramatic performanceSkills demonstrationPersuasive speakingDRA™2Final exams can be modified for instructional window. AP type exams can be created for students using prior year’s questions so that data is available by the end of the year.SGO Guidebook pg.10
42 Assessment Quality Standards Alignment and Coverage In district teams, refer to the social studies assessment provided.Using the Standards Alignment and Coverage Check form, make a note of the items in the assessment that are aligned to the standards you have identified.How would you judge the alignment? Use a scale of 1-10.
44 Assessment Quality Depth of Knowledge 4 minute video explaining DOK using the Gettysburg AddressWorkshop packet pg. 11
45 Assessment Quality Depth of Knowledge How rigorous is your assessment?Choose several items from your assessment.Categorize them as level 1-4 on the Assessment Rigor and Depth of Knowledge Analysis form.Discuss what modifications of this assessment may be necessary.
48 Collection of Evidence Ensure that scoring and administration of school-based assessments relies on valid, reliable, and practical systems.
49 Collection of Evidence Quality Rubrics Strong rubrics ensure that a student’s knowledge of a subject or skill is accurately assessed.Identify the knowledge and skills being measuredDifferentiate between high and low achievementClearly identify and describe levels of performance for each elementDetermine component weighting as necessaryCreate and share with colleagues to ensure rigor and alignment to common expectations
50 Collection of Evidence Quality Rubrics Grades 9-12 Common Core History and Social Studies RubricsKey Ideas and DetailsRH Cite specific textual evidence to support analysis of primary and secondary sources, connecting insights gained from specific details to an understanding of the text as a whole.Needs Specific ImprovementApproachingMeets ExpectationsExceedsLacks specific details from the textDoes not connect details to the text as a whole.Contains some specific details from the text but omits the most important onesAttempts to connect details to the text as a whole.Cites specific evidence to support the analysis of the text-Connects insights from specific details to the text as a whole.Meets expectations and performs one of the following:Brings in outside information from prior knowledge/other sourcesDemonstrates a connection between the historical context of the document and the modern day.Differentiate between high and low achievementIdentify the knowledge and skills being measuredClearly identify and describe levels of performance for each element
51 Collection of Evidence Administration and Scoring of Assessments What are the most valid, reliable, and practical ways to administer and score school-based assessments in your district?In your district team discuss the following:Will assessments be administered in one sitting or several?Should the students’ teacher be the one administering the assessment?Who should score the assessments?Would professional development in scoring or other aspects of assessment be useful in your district?Open up the discussion at the table and share your ideas.
52 5 Steps of the SGO Process Step 1 Choose or develop a quality assessment aligned to NJCCCS or CCSS. Step 2 Determine students’ starting points. Step 3 Set ambitious and achievable SGOs with the approval of the principal. Step 4 Track progress, refine instruction. Step 5 Review results and score in consultation with your principal/supervisor.
53 7. Which of the following data sources can be used to determine students’ starting points? Check all that apply.A rigorous and carefully constructed pre-assessmentGrades from the student’s prior year classes relevant to the current classTest scores from the prior year in relevant classesGrades from the current yearSurvey - Question 7
54 Step 2 – Determine Students’ Starting Points Examples Source of Performance Data to Determine Students’ Starting PointsExamples and NotesGrades/performance in current yearBased on all aspects of work during the first few weeks of schoolBeginning-of-course diagnostic tests or performance tasksDepartment-generated pre-assessmentEarly course testPrior-year test results that assess knowledge and skills that are pre-requisites to the current subject/gradeNJASK for math, LAL and scienceDRA for readingEnd of course assessmentsTest results in other relevant subjects from prior yearsA physics teacher uses results of her students’ math tests from last yearStudents’ grades in previous classesTeachers should make sure they understand the basis for the grades given by students’ previous teachersSurvey - Question 7
55 Step 2 – Determine Students’ Starting Points Multiple Sources of Data A 9th-grade LAL teacher has two sets of data readily available: a department-wide pre-assessment that is based on the content and structure of the final assessment and scores on the portfolio that the students completed the previous year.StudentPortfolio Score (June 2013)Pre-Assessment (Sep 2013)Preparedness Group18976High26843Low37854Medium48666
56 5 Steps of the SGO Process Step 1 Choose or develop a quality assessment aligned to NJCCCS or CCSS. Step 2 Determine students’ starting points. Step 3 Set ambitious and achievable SGOs with the approval of the principal. Step 4 Track progress, refine instruction. Step 5 Review results and score in consultation with your principal/supervisor.
57 Step 3 – Set Growth Objectives Scoring Rubric Attainment of Student Growth ObjectiveExceptional4Full3Partial2Insufficient1Teacher has demonstrated an exceptional impact on learning by exceeding the objective.Teacher has demonstrated a considerable impact on learning by meeting the objective.Teacher has demonstrated some impact on learning but did not meet the objective.Teacher has demonstrated an insufficient impact on learning by falling far short of the objective.
58 Step 3 – Set Growth Objectives SGO Scoring Guide Target ScoreAttainment Level in Meeting Student Growth Objective80% or Higher on Final AssessmentExceptional4Full3Partial2Insufficient1Percent of Students Meeting TargetGreater than 84%70-84%55-69%Less than 55%
59 Step 3 – Set Growth Objectives Tiered SGO Scoring Guide GroupsTarget Score on Final AssessmentObjective Attainment Based on Percent of Students Achieving Target ScoreExceptional 4Full3Partial2Insufficient 1Low70%At least 90%At least 80%At least 70%Less than 70%Medium80%High90%Workshop packet pg. 7
60 5 Steps of the SGO Process Step 1 Choose or develop a quality assessment aligned to NJCCCS or CCSS. Step 2 Determine students’ starting points. Step 3 Set ambitious and achievable SGOs with the approval of the principal. Step 4 Track progress, refine instruction. Step 5 Review results and score in consultation with your principal/supervisor.
61 Step 4– Track Progress, Refine Instruction The Most Important Work
62 Your Next StepsDiscuss with your district team some of the key lessons you have learned from today’s workshop.Agree to follow up with1-3 concrete next steps to facilitate the SGO development process in your school.Share with your table and the larger group when asked.Workshop packet pg. 1
63 Resources at the NJDOE AchieveNJ SGO Training modules - online in June Future workshops – provisionally planned for September/OctoberUpdates, samples, and bulletinsPartner with us on creating exemplar SGOs
64 Final Thoughts on SGOsContinue doing what is effective for your studentsUse or adapt assessments that you already useSupport each other and shareDon’t let perfection get in the way of the good