Presentation on theme: "Delaware Department of Education August 2012 Version 2 – 8/15/2012"— Presentation transcript:
1 Delaware Department of Education August 2012 Version 2 – 8/15/2012 DPAS II (R) TrainingDelaware Department of EducationAugust 2012Version 2 – 8/15/2012Version
2 WelcomeComing together is a beginning. Keeping together is progress. Working together is success.Henry Ford
3 Norms We will: Begin and end on time Respect one another by having one conversation at a time, unless otherwise directedSilence all cell phones, computers, iPads, pagers, or other electronic devices that have sound
4 Goals for TodayUnderstand the DPASII(R) evaluation system for Components I-V for the school yearReview the policies and implementation of Component VUnderstand tools and resources for implementing Component VTeam/Implementation PlanningVersion
5 Agenda Welcome 8:15 – 8:30 DPAS Components I-IV 8:30 – 9:00 DPAS Component V 9:00 – 10:45Break 10:45 – 11:00Tools and Resources 11:00 – 12:00Lunch – on your own 12:00 – 1:30SunGard Presentation 1:30 – 3:00Team Planning 3:00 – 3:45
6 Team Expectations Teamwork divides the task and doubles the success. UnknownToday’s focus:Understand the changes and new features of DPAS II (R) Component VShare this information and support implementation back in your schools
7 Goal 1: Understand the DPASII(R) Evaluation System for Components I-V for the 2012-13 School Year
9 Understanding DPAS II (R): Components I-IV TeachersSpecialistsAdministratorsComponent 1Planning & PreparationVision & GoalsComponent 2Classroom EnvironmentProfessional Practice & Delivery of ServicesCulture of LearningComponent 3InstructionProfessional Collaboration & ConsultationManagementComponent 4Professional ResponsibilitiesComponent 5Student ImprovementVersion
10 Understanding DPAS II(R): Components I-IV What changed in ?Use of rubrics during the evaluation process to guide discussion and appraisalAddition of “expectations” and definition of recommendation versus expectationAdded classroom assessment criterion in Teacher and Specialist Components 1 and 3Shifted to Component 4 being assessed throughout the evaluation processCreated DOE Supports/Structures: DOE monitoring of DPAS II documentation, Development Coaches, & Expert Evaluators
11 Understanding DPAS II(R): Components I-IV What’s new in ?Educators should continue to move forward with Components I-IV, building upon the rigor/focus from last year.Component V as described here today, and its overall impact on an educator’s evaluation, is the major shift in DPAS II (R) for
12 Goal 2: Review the Policies and Implementation of Component V
13 Background: How we got here… National Conversation…Race to the Top…Educator involvement…
14 Understanding DPAS II(R): Component V Purpose/PhilosophyFocus on building a school climate where everyone is focused on the improvement of student achievement.Bringing back a focus on conferences and conversation between educators and administrators.
15 Understanding policy and implementation for Component V. What’s New?Three Educator GroupsThree Measures
16 Who are the educator groups? Teacher of Record – The teacher of record is a full-time teacher, as defined in the DPAS II regulation 106A (revised), who has been assigned the primary responsibility for a student’s learning in a course/class, provided the student has been enrolled at least 85% of the time that the class is in session.GroupsGeneralizations about the categoryGroup IAre you the reading and/or math Teacher of Record and give grades for at least 10 students in a DCAS – tested grade 3-10?Group IIAre you the Teacher of Record and give grades for at least 10 students at any grade level or subject other than DCAS reading and/or math?Group IIIAny educator who does not meet the criteria for Group I or Group II will defer to Group III
17 ExamplesI am a third grade teacher of record for 22 students – which group?I am a ninth grade science teacher of record for 6 different classes – which group?I am a fourth grade special education teacher in a TAM classroom – which group?I am a second grade Music teacher who only reports “S” or “U” for students – which group?
18 What are the three (3) types of Measures? MEASURE AMEASURE BMEASURE C
19 Measure ABased upon DCAS instructional scale scores for reading and/or math in grades three (3) through ten (10)
20 Measure B Two (2) different assessments External Assessment DDOE approved, standardized assessments that can be used at the discretion of the districtDIBELS, STAR Math, STAR ReadingInternal AssessmentDDOE approved, educator developed assessments specific to subject and grade levelPre/Post Student Assessments
21 Measure C Growth Goals DDOE approved, educator developed goals Specific to content area and/or job assignmentIncludes a mix of: student growth and professional outcomes
22 How do we match educator groups to the measures? Measure AMeasure BMeasure CGroup I50%Group IIGroup III100%
23 Group I Educators and Measures Measure A – DCASMeasure B – External/InternalGroup I50%Group I Teachers:MUST use a minimum of two (2) measuresMUST use Measure A for all students assessed by DCAS in reading and/or math for grades three (3) through (10)MUST use at least one (1) Measure BMeasure A and Measure B weighted 50% each
24 Group II Educators and Measures Group II Teachers:MUST use a minimum of four (4) measuresMUST use at least one (1) Measure B and one (1) Measure CMeasure B and Measure C weighted 50% eachMeasure B – External/InternalMeasure C – Growth GoalsGroup II50%
25 Group III Educators and Measures MUST use a minimum of four (4) Measure C’sMeasure C weighted 100%Measure C – Growth GoalsGroup III100%
26 ExamplesI am a third grade teacher of record for 22 students – Group 1, which measures?I am a ninth grade science teacher of record for 6 different classes – Group 2, which measures?I am a fourth grade special education teacher in a TAM classroom – Group 1, which measures?I am a second grade Music teacher who only reports “S” or “U” for students – Group 2, which measures?
27 Other Considerations Alternative Internal Measures Internal Measure Rubric will serve as a guide to provide feedback about the alternative measure.Form must be submitted to DDOE for approvalAlternative Growth Goal MeasuresGrowth Goal Template used as a guide for development of alternative growth goal(s).
28 DPAS II Ratings Remember… Component V acts as a gate-keeper Criterion RatingsUnsatisfactory, Basic, Proficient, DistinguishedComponent I-IV RatingsSatisfactory or UnsatisfactoryComponent V RatingsExceeds, Satisfactory, UnsatisfactorySummative RatingsHighly Effective, Effective, Needs Improvement, IneffectiveComponent V acts as a gate-keeper
29 How will Measure A be rated? ExceedsSatisfactoryUnsatisfactory (with administrator discretion)Unsatisfactory65% or more of a teacher’s DCAS student growth targets are met50-64% of a teacher’s DCAS student growth targets are met35-49% of a teacher’s DCAS student growth targets are met (conference between administrator and teacher could provide option to upgrade to a “Satisfactory” rating)Less than 35% of a teacher’s DCAS student growth targets are met
30 How are Measure A Growth Targets set? Growth Targets will be provided by the Department of EducationFor the school years, Growth Targets will be determined based on DCAS instructional scale score growth achieved by “similar students” in and school years.Similar students are:Students in the same grade and subjectSame fall scoreSame ELL (English Language Learner)Same SWD (Student with Disability); or,Non-SWD/ELLStudents who achieve PL4s in the spring will count as having met their growth targets for that school year.
31 How will Measure B and C be rated? ExceedsSatisfactoryUnsatisfactoryThe agreed upon “exceeds” target is met or surpassed.The agreed upon “satisfactory” target is met or surpassed, but the “exceeds” target is not met.The agreed upon “satisfactory” target is not met.
32 How are Measure B and Measure C Growth Targets set? Based on professional conversations between the administrator and educatorAgree upon measures usedAgree upon a “satisfactory” target and an “exceeds” target
33 Example for Measure BIn the Fall, administrator and educator agreed upon:Grade 2 ELA pre/post assessment80% of the targeted group will show improvement in fluency within the last six weeks of the school year as compared to the first six weeks of the school year.Achievement ranges:Exceeds: 90% of all students received a 70 or higher on the spring post-test compared to 55% receiving a 70 or higher on the fall pre-test.Satisfactory: 80% of all students received a 70 or higher on the spring post-test compared to 55% receiving a 70 or higher on the fall pre-test.Version
34 Example for Measure CIn the Fall, administrator and educator agreed upon:Standard 5 – Implementation (for access to learning)Indicator – Absences Due to IllnessStudents will demonstrate decreased absenteeismTarget Goal: 50% improvement – Number of students showing improvement at the end of selected time divided by total number of students in cohortAchievement ranges:Exceeds: 60% of targeted number of students showing improvement at the end of the selected time period compared to the beginning time period (i.e., current school year compared to previous school year or identified marking period)Satisfactory: 50% of targeted number of students showing improvement at the end of the selected time period compared to the beginning time period
35 Component Five Ratings Possible Rating CombinationsOverall Component V RatingExceedsSatisfactoryUnsatisfactoryUnsatisfactory – administrator can upgrade to “Satisfactory” rating
36 Summative Ratings Total # of Satisfactory ratings in Components I-IV Component FiveSummative Rating4/4ExceedsHighly EffectiveSatisfactoryEffectiveUnsatisfactoryNeeds Improvement3/42/4Ineffective1/40/4
37 How does my Component V rating impact my Evaluation in a year when my evaluator does not complete a Summative Evaluation for me?Novice educators receive a full evaluation cycle annually (complete Summative). A previous year's Summative Evaluation rating of "Needs Improvement" or "Ineffective" mandates a Summative Evaluation for that educator be completed the following year. LEAs have the option of conducting Summative Evaluations for all educators on a annual basis.
38 How does my Component V rating impact my Evaluation in a year when my evaluator does not complete a Summative Evaluation for me?For Experienced educators, Regulation 106A denotes that only when a Summative Evaluation is completed can Component V impact the educator's summative rating. Component V is conducted, calculated and shared for each educator each year even when a Summative Evaluation is not being completed.The Department, and LEAs, can promulgate programs that utilize the Component V rating (standing alone) such as the state’s Talent Retention/Attraction program(s).
39 Goal 3: Understand Tools and Resources for Implementing Component V
40 DPAS II(R) Component V Process Teacher of Record The teacher of record is a full-time teacher, as defined in the DPAS II regulation 106A (revised), who has been assigned the responsibility for a student’s learning in a course/class, provided the student has been enrolled at least 85% of the time that the class is in session.Version
41 DPAS II(R) Component V Process Measures / Target Process Review: Educator Groups • Group 1: Includes any teacher who instructs reading and/or mathematics in DCAS grades three (3) through (10). • Group 2: Includes any teacher who reports student grades in any grade or subject where DCAS reading and math is not administered. • Group 3: Includes any teacher who generally does NOT report student grades and any educator who cannot otherwise be categorized into Groups I or 2.Version
42 DPAS II(R) Component V Process Educator Groups 1 & 2 ONLY: Roster Verification Due to the nature of Measure A & B and their alignment with student growth, it is necessary to ensure valid class rosters.Educator Groups 1 & 2 will be measuring student growth across all classes, a class and/or a cohort of students within a class.To ensure an accurate account of the students an educator is responsible for, it is necessary to verify an educator’s roster.Version
43 DPAS II(R) Component V Process Educator Groups 1 & 2 ONLY: Roster Verification Teacher reviews class rosters for all classes in PerformancePLUS.If a student is listed on roster and is not attending class, the teacher will notify the school administrator in writing and request the change(s) be made in eSchool.Remember, a student attending a program such as SCOPE or PEAK cannot be removed from a teacher’s roster even though they are not attending class.If this is the case, the teacher should print out roster, note the discrepancy including the reason, and discuss with administrator.Version
44 DPAS II(R) Component V Process Measures Selection Review: GuidelinesGroup 1 educators:MUST use Measure A and at least one (1) Measure BGroup 2 educators:MUST use a minimum of four (4) measuresMUST use at least one (1) Measure B and at least one (1) Measure CGroup 3 educators:MUST use Measure CVersion
45 DPAS II(R) Component V Process Review: Measures Measure A:Based upon DCAS instructional scale scores for reading and/or mathematics in grades three (3) through ten (10)Measure B:Comprised of two types of alternate measures: 1) internal assessments that are educator-developed and DDOE-approved specific to subjects and grade levels; and 2) external measures that are DDOE-approved and can be used at the discretion of each district.Measure C:Growth goals are educator-developed and DDOE-approved goals specific to content areas and job assignments.Version
46 DPAS II(R) Component V Process Measures / Target Selection Form DPAS II(R) Component V Process Measures / Target Selection Form *Note: October 15th is a recommended dateVersion
47 DPAS II(R) Component V Process Measures / Target Selection Form DPAS II(R) Component V Process Measures / Target Selection Form *Note: October 15th is a recommended dateVersion
48 DPAS II(R) Component V Process Measures / Target Selection Form DPAS II(R) Component V Process Measures / Target Selection Form *Note: October 15th is a recommended dateVersion
49 DPAS II(R) Component V Process Measures / Target Selection Form DPAS II(R) Component V Process Measures / Target Selection Form *Note: October 15th is a recommended dateVersion
50 DPAS II(R) Component V Process Measures / Target Selection Form DPAS II(R) Component V Process Measures / Target Selection Form *Note: October 15th is a recommended dateVersion
51 DPAS II(R) Component V Process Measures MUST be approved by evaluators prior to using any measure! *Note: October 15th is a recommended dateVersion
52 DPAS II(R) Component V Process Target Selection Process Measure A:Students complete Fall administration of DCAS in reading and/or mathematicsVersion
53 DPAS II(R) Component V Process Target Selection Process Measure B:Administer and score approved Internal or External MeasureComplete Bubble Sheet and Scan Results into Performance PlusAnalyze data and develop both “satisfactory” and “exceeds” targets based upon the identified area(s) of need for their class of students or selected group of students.Record the proposed targets in the Data and Evidence Collection Procedures Chart.Fall ConferenceVersion
54 DPAS II(R) Component V Process Target Selection Process Version
55 DPAS II(R) Component V Process Target Selection Process Measure C:Collect data from eSchool, College Board, TIDE, etc.Analyze data for EACH goal.Develop both “satisfactory” and “exceeds” targets based upon the identified area(s) of need for a selected group(s) of students for EACH goal.Record the proposed targets in the Data and Evidence Collection Procedures Chart.Fall ConferenceVersion
56 DPAS II(R) Component V Process What does a good Student Growth Target look like?Version
57 DPAS II(R) Component V Process Student Growth Target Guiding Principles 1Setting ambitious, achievable goals for students is good instructional practice. Goals establish a vision for what students should be able to accomplish at the end of the year.2Strong goals share certain characteristics. However, no single goal or assessment is appropriate for all grades, content areas, or students.3Therefore, it is not the intent of the state to prescribe how educators set student growth targets. This practice should be driven by those closest to students.Version
58 DPAS II(R) Component V Process What is a Student Growth Target? A Student Growth Target is a measurable goal for student achievement over a given period of time.Strong student growth targets share three key characteristics:Priority ContentFocuses on learning content that is aligned to state and/or common core standards (when applicable).RigorRepresents an appropriate amount of student learning (challenging, yet attainable) for the specified interval of instruction and specified set of students.High-Quality EvidenceAssessment provides data from the beginning and end of students’ time with teacher and is based on a common assessment when available.Version
59 A good goal statement is one that is… DPAS II(R) Component V Process What Do Strong Student Growth Targets Look Like?Goal Statement:Increase the percentage of students who are proficient (above 70%) in Integrated Mathematics I from 33% in September, 2012 to 75% in June, 2012, as measured by the Department of Education Internal Measure B: Integrated Mathematics I. A good goal statement is one that is…SpecificMeasurableAppropriateRealisticTime-boundVersion
60 DPAS II(R) Component V Process What Do Strong Student Growth Targets Look Like? During the school year, my sixth grade physical education students will improve performance by 20% on each of the Presidential Fitness Test sub areas.Specific: Focused on physical education, specifically the Presidential Fitness sub areasMeasurable: Identified Presidential Fitness Test to be used to assess goalAppropriate: The teacher teaches the content and skills contained in the Presidential Fitness Tests.Realistic: The goal of increasing student performance by 20% is realistic. It is not out of reach and yet not too easy.Time-bound: Goal attainment can be addressed by the end of the year with the final Presidential Fitness Test.Version
61 DPAS II(R) Component V Process Target Selection Process Version
62 DPAS II(R) Component V Process SCENARIO: Hypothetical Classroom Data Suppose you’re teaching mathematics to a class of 20 fourth grade students. You know that students from this school have had trouble with measurement items on the state test in previous years, and you’re wondering whether you need to do more teaching in this area. After reviewing Measure B for fourth grade mathematics, you discover that the assessment targets the Domain: Measurement and Data. You received approval from your evaluator to use the Internal Measure developed by educators to identify the strengths and/or weaknesses of your students in measurement, and administered the assessment to your entire class. Your students obtained the scores shown in Table 1.Version
63 DPAS II(R) Component V Process SCENARIO: Hypothetical Classroom Data Version
64 DPAS II(R) Component V Process Fall Conference The teacher and administrator will meet (Fall Conference) to discuss the growth expectations for students.Using the Measures / Target Form, the teacher and administrator will agree upon the identified areas of need and focus for the school year.Version
65 DPAS II(R) Component V Process Fall Conference Group 1Measure A targets will be provided by the Department of Education: Student Growth TablesFinalize targets for Measure B assessmentRecord in Data and Evidence Collection Procedures Chart.Group 2Set targets for Measure B assessment(s)Finalize targets for Measure C Growth GoalsGroup 3Version
66 Performance PLUS and Component V Department of Education
67 Why SunGard? Pupil Accounting contracted in1999 with SunGard eSchoolPLUS and IEPPlusStudent Longitudinal Data Systems Grant$5 million for three yearsPerformance PLUS products for curriculum and assessment managementComponent VGrowth ModuleDelivery mechanism
68 Performance Plus software The software is hosted at SunGard and is currently being set up so that Delaware may use itThe goal is to be live by August 27, 2012This week in the DOE we are setting up agents which will synchronize the eSchoolPLUS databases with the Performance PLUS databases
69 Component V Assessments SunGard has received most of the assessments from DOE and are entering them into the Performance Plus softwareThe goal is to be live by August 27, 2012The DOE will work with contributors to verify the assessments in the software before going live
70 Growth Goal ModuleThe Growth Goal Module is currently being programmed into Performance PLUS and will be available by August 27
71 ImplementationPhase 1 is going on now with the purpose of delivering the Component V assessments in SeptemberPhase 2 will begin in October. This will be the full implementation of Performance Plus (Assessment Builder, Performance Tracker, Curriculum Connector)The planning has not begun with SunGard yet on Phase 2
72 TrainingTechnical training schedule has been sent out to the districts and charters:There are two parts to the training:printing, scanning, and uploading bubble sheets; and entering growth goals (early September)bubble sheet scanning and uploading onsite assistance; and entering growth goals assistance (mid to late September)
73 CostThe DOE will provide the districts and charters $3.00 per student to defray the costs of printing and scanningYou may use these funds as you wish for this project
74 Access to Performance Plus There will be a link in eSchoolPLUS or Teacher Access Module which will take you to Performance PLUSThere is no need to log into Performance PLUS separately
75 Bubble SheetsThe DOE decided to use bubble sheets this September for the Component V assessments because there was not enough time to set up online testingHowever in Phase 2 implementation you will have the ability to use the online moduleThe bubble sheets and test booklets will be printed out in your school/districtThe teacher/specialist will log into Performance Plus, pick the class, and print the bubble sheets and test bookletsThe printer must be a laser printerThe DOE is currently testing printing and scanning and will send an update next week
76 Scanners The DOE is not recommending a particular scanner or vendor I have tested scanning and have been successful. But I have not gotten to the point of saving to a file on a computerBasic scanner settings:scan black and white imagessave as TIFF format200 DPI
77 HelpdeskThe helpdesk for Performance Plus will be the same as eSchoolPLUS or IEPPlusDistrict and Charter pupil accounting coordinators will be the primary contactFor policy questions please refer to your curriculum officeFor assistance during the September Component V assessments we will provide the pupil accounting coordinators with a phone number to directly call SunGard if our helpdesk cannot assist you
78 Scheduling in eSchoolPLUS For teachers/specialists to print out bubble sheets they must have a class and students enrolled in that classThe DOE is currently in the process of assisting the districts and charters in scheduling primarily elementary schools and special schoolsThis must be completed before you can use the Component V module in Performance PLUS
79 Integration All of the DOE systems are integrated: IMS eSchoolPLUS IEPPlusPerformancePLUSDashboard
80 PerformancePLUS “….develop each child intellectually, artistically, emotionally, physically, andsocially so that all students are life-longlearners, complex thinkers, responsibleglobal citizens and effective communicators.”PerformancePLUS
81 Agenda PerformancePLUS Products Overview Measure B Measure C PerformanceTRACKERAssessmentBUILDERCurriculumCONNECTORImplementationMeasure BPre/Post Assessment FacilitationMeasure CGrowth Goal Module
83 Implementation Phase I Phase II Measures B & C Training Individual district/school full implementationMore to come…
84 Training Starting August 28 2 sessions for each district Printing bubble sheets, scanning and uploadingScanning and uploading supportWho should attend?Bubble Builder/ReaderPupil Accounting CoordinatorTesting CoordinatorDistrict RepresentativeHigh School RepresentativeGrowth GoalsCore team of 25 people who will train remainder of staff
85 Pre/Post Assessment Facilitation Measure B Validate Class RosterPrint Bubble Sheets and AssessmentsEasy 3-Step ProcessAdminister AssessmentsScan Bubble SheetsUpload Bubble Sheets
89 **Install bubble and bar code fonts before printing, if necessary. Print Bubble Sheets**Install bubble and bar code fonts before printing, if necessary.
90 Print Bubble Sheets/Test Booklets Bubble Sheet Printing InstructionsMust be printed via a laser jet printerMust be printed with correct marginsSee sample instructionsStudent Test Booklets, Scoring Guides, etcCan all be printed from this page!
100 Team Planning Time1) How will you communicate Component V and the tasks that educators need to complete to the rest of your school?How will you support the educators in your school on the process during the upcoming academic year?
101 Next StepsPower Point Updated and put on DOE website by August 17, 2012FAQs from training put on DOE website by August 17, 2012Excerpts from DPAS II(R) Teacher’s Guide put on DOE website by August 17, 2012DPAS II(R) Teacher, Specialist, Administrator Guides updated by August 24, 2012Online DOE Training Modules for Teachers, Specialists, AdministratorsOnline SunGard Training – Performance PlusSeptember DOE Trainings for any school team not able to attend the August trainings. Tentative dates & locations:Monday, September 24th – New Castle CountyTuesday, September 25th – Kent CountyThursday, September 27th – Sussex County