MVSA Ron Noble - ESE October 16, 2013 DDMs: Updates and Discussion

Massachusetts Department of Elementary & Secondary Education The Educator Evaluation Framework Exemplary Proficient Needs Improvement Unsatisfactory High Moderate Low Summative Performance Rating Student Impact Rating  Everyone earns two ratings 2

Massachusetts Department of Elementary & Secondary Education 3 Two Ratings Summative Rating UnsatisfactoryImprovement Plan Needs Improvement Directed Growth Plan Exemplary Self-Directed Growth Plan Proficient 1-yr Self-Directed Growth Plan 2-yr Self-Directed Growth Plan LowModerateHigh Rating of Impact on Student Learning

Massachusetts Department of Elementary & Secondary Education 4 Student Impact Rating  Evaluators must assign a rating based on trends (at least 2 years) and patterns (at least 2 measures)  Options:  Statewide growth measure(s) must be used, where available  District-determined Measure(s) of student learning comparable across grade or subject district-wide.

Massachusetts Department of Elementary & Secondary Education 5 Student Impact Rating – 2 examples YearMeasureStudent Results Year 1MCAS SGP, grade 8 English language artsLow growth Year 1Writing assessmentModerate growth Year 2MCAS SGP, grade 8 English language artsModerate growth Year 2Portfolio assessmentModerate growth YearMeasureStudent Results Year 1MCAS SGP, grade 8 English language artsHigh growth Year 1Writing assessmentModerate growth Year 2MCAS SGP, grade 8 English language artsHigh growth Year 2Writing assessmentModerate growth Year 2Portfolio assessmentModerate growth

Massachusetts Department of Elementary & Secondary Education 6 Definition “Measures of student learning, growth, and achievement related to the Massachusetts Curriculum Frameworks, Massachusetts Vocational Technical Education Frameworks, or other relevant frameworks, that are comparable across grade or subject level district-wide. These measures may include, but shall not be limited to: portfolios, approved commercial assessments and district-developed pre and post unit and course assessments, and capstone projects.” 603 CMR  Student Measures  Aligned to Frameworks  Comparable Across District  Expansive Definition of Acceptable Measures

Massachusetts Department of Elementary & Secondary Education 7 SY DDM Milestones DateAction September 2013 Example DDMs released: All districts and RTTT charter schools submit list of DDMs to pilot during the year. Template available here: Sept – June 2014 All districts and RTTT charter schools pilot DDMs June 2014 All districts and RTTT charter schools submit final plans, including any extension requests, for implementing DDMs during the school year*. *ESE will release the June 2014 submission template and DDM implementation extension request form in December

Massachusetts Department of Elementary & Secondary Education 8 DDM Implementation Timeline  August 15 th – Commissioner’s Memorandum  Extension requests will be coupled with June 2014 submissions  One-year extension of DDM implementation for particular grade(s)/subject(s) or course(s) for which the district has not yet identified DDMs.  Blanket extensions will not be granted.  Use judiciously - not all districts will need an extension  Not a pause button.

Massachusetts Department of Elementary & Secondary Education 9 DDM Key Questions  Is the measure aligned to content?  Does it assess what the educators intend to teach and what’s most important for students to learn?  Is the measure informative?  Do the results tell educators whether students are making the desired progress, falling short, or excelling?  Do the results provide valuable information to schools and districts about their educators?

Massachusetts Department of Elementary & Secondary Education 10 Refining your Pilot DDMs  Districts will employ a variety of approaches to identify pilot DDMs (e.g., build, borrow, buy).  Key considerations: 1.How well does the assessment measure growth? 2.Is there a common administration protocol? 3.Is there a common scoring process? 4.How do results correspond to low, moderate, of high growth? 5.Is the assessment comparable to other DDMs?  Use the DDM Key Questions and these considerations to strengthen your assessments during the pilot year.

Massachusetts Department of Elementary & Secondary Education 11 Resources Available Now:  Technical Guide B  DDMs and Assessment Literacy Webinar Series  Technical Assistance and Networking Sessions  Core Course Objectives and Example DDMs Coming Soon  Model Contract Language  DDM Pilot Plan Cohorts  Using Current Assessments Guidance (Curriculum Summit)

Massachusetts Department of Elementary & Secondary Education 12 Example Assessments  150 assessments that provide over 800 options for different grades/subjects and courses.  More complete open source assessments coming!  We need your help! Please submit:  Assessment directions, materials, items and prompts  Scoring resources (rubrics, answer keys)  Other information (steps for administration, lesson plans, examples of how results are used)  To submit your examples, complete the survey and upload your materials at  WestEd's DDM submission help line at (415) (10:00 a.m. and 7:00 p.m. EST.) 12

Massachusetts Department of Elementary & Secondary Education 13 Example Assessments  Key features of each option are described in a one-page summary.  Each one-pager includes a link for additional information.

Massachusetts Department of Elementary & Secondary Education 14 Ongoing Work with WestEd 1.Continued collection and evaluation of locally- developed assessments. 2.Evaluation of all collected assessments for additional grade/subject and course coverage, specifically to expand the collection of Example DDMs in the minimum pilot areas. 3.Analyze new information submitted by assessment developers and make appropriate revisions to one- page summaries. 4.Execute a scope of work that will yield Example DDMs in the CVTE program areas

Massachusetts Department of Elementary & Secondary Education 15 Using Current Assessments  Presentation  Guidance Document: Using Current Assessments in DDMs  Curriculum Summit November 6 th and 7 th  Content  Three steps for bringing together multiple assessments from across the year to measure growth  Two concrete examples of this process using the Curriculum Embedded Performance Assessments (CEPAs) from the Model Curriculum Units (MCUs)

Massachusetts Department of Elementary & Secondary Education 16 DDMs: 4 Key Messages 1.DDMs are part of a multidimensional framework.  Decisions about an educator’s impact or effectiveness will never be based of the results of a single DDM. 2.Focus is on students, not just educators  DDMs must yield information that will be useful to educators in improving student outcomes. 3.This is about building capacity.  DDMs provide districts a good reason to consider ways to refine and improve existing assessment practices. 4.Teachers have the necessary skills to lead the process of identifying DDMs – You can do this!  Many districts will have success leveraging teacher- developed assessments to develop DDMs.