Presentation is loading. Please wait.

Presentation is loading. Please wait.

1 March, 2014 NYC DOE Office of Academic Quality EOY MOSL Assessment Administration and Scoring Process & MOSL Updates.

Similar presentations


Presentation on theme: "1 March, 2014 NYC DOE Office of Academic Quality EOY MOSL Assessment Administration and Scoring Process & MOSL Updates."— Presentation transcript:

1 1 March, 2014 NYC DOE Office of Academic Quality EOY MOSL Assessment Administration and Scoring Process & MOSL Updates

2 2 Agenda Orientation to the Measures of Student Learning (MOSL) End-of-Year Assessment, Administration, and Scoring Handbook Review MOSL Selections & EOY Assessments Updates K-2 NYC Performance Test ELA Texts Math Double Testing Waiver for Grade 7 & 8 Students in Accelerated Courses Calendar Change Requests Advance Implementation Funding: SAM 60 Teacher Level Selection Tool Create an EOY Advance Implementation Plan Questions

3 Session Approach and Norms 3 High Engagement, Low Tech – Please turn cell phones on silent. Contribute to the Learning – Throughout the afternoon, write any outstanding questions on index cards and place them in the center of your table. Q&A at the end of the day will address these and any other lingering questions. Maximize Our Time Together – Be Mindful of “Airtime”— Use this day to collaborate, troubleshoot and brainstorm with your colleagues. Save complex, individual questions for other avenues of communication and support.

4 Objectives Participants will gain a high-level understanding of the step-by-step process schools must complete to successfully administer and score EOY assessments centered on the EOY Assessment Administration Checklist 4 Participants will create an End-of-Year MOSL Implementation Plan

5 5 Where to Begin? EOY MOSL Assessment Administration Handbook Online guide, located on the Intranet One-stop, comprehensive resource that organizes all guidance related to administering and scoring MOSL assessments. Numerous hyperlinks to all relevant resources. Organized according to implementation step and assessment: Plan for EOY administration Prepare and administer Score and submit Please note that information connected to specific page numbers in the EOY Handbook and related materials are subject to change pending the final release of the EOY MOSL Assessment Administration Handbook. Take 3-4 minutes to orient yourself to the handbook.

6 Review MOSL Selections & EOY MOSL Assessments Review your school specific MOSL Selections Review the MOSL Assessments in yellow on the right of your spreadsheet The yellow highlighted area identifies the specific MOSL assessments your school is required to administer by grade based on your MOSL selections 6

7 Understanding EOY Administration and Scoring 7 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Keeping your MOSL Selections & EOY Assessments in mind, take 10 minutes to independently review the: Overview for Principals (P. 2-3) End-of-Year Assessment Calendar for Advance (P. 4-5) NYC Performance Assessments- End-of-Year Assessment Topics Administrator EOY MOSL Assessment Checklist (P. 7-11) Note any questions that arise. Which steps might be the most challenging for your school? 

8 Navigating the EOY Assessment Administration and Scoring Handbook 8 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials  Overview of the Handbook’s Structure EOY Checklist- The entire Handbook is organized into this 7-step process. The Checklist can help you navigate to the information you need, serving as a table of contents for the document. You can click on the orange headers to link to the assessment specific information you need. Each section of the Handbook serves as a stand-alone resource: Overview for Principals Calendar Planning Tool Four administration and scoring guidance documents: NYC Performance Assessments Running Records FAST Scantron Performance Series

9 Step 1: Plan for EOY Administration and Scoring 9 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Review windows for printing, administration, norming and scoring If necessary, consider additional dates and times for norming and scoring EOY assessments. If relevant, consider content of NYC Performance Assessments and ensure assessment schedule is aligned with course curricula. Identify and schedule key EOY administration tasks and assign roles and responsibilities, including: Perform roster verification Confirm/ update Teacher-Level MOSL Selections in the Advance Web Application (functionality tentatively available March 24 th ) Share Teacher Assessment Administration Checklist with teachers Schedule assessment printing, administration, norming and scoring activities

10 New Resource Spotlight: 10 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Designed to support principals and assessment coordinators to create an end-of-year assessment implementation calendar for their school. Contains action steps and templates that will help identify key tasks and dates. Includes a calendar template with key milestones highlighted to support school leaders integrate these EOY MOSL tasks into existing timelines and structures. Calendar Planning Tool Pgs  We will look at the Calendar Planning Tool more closely later in the training and allow time for you to create an EOY Advance implementation plan.

11 New Resource Spotlight: 11 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Similar to the EOY MOSL Assessment Checklist (P. 7-11), but shares relevant EOY assessment information tailored to teachers Contains specific action items aligned to each of the 7 steps. Teacher Checklist has been released on the Advance intranet page and is included in your folder. Teacher Checklist 

12 Step 2: Prepare Assessments 12 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Each assessment requires different preparation steps. Depending on the assessment, specific tasks may include the following: Select and download certain online assessment(s). Print or request assessment materials (FAST) Receive or select texts Print ATS score sheets (when necessary) Ensure teachers have the relevant materials necessary to administer the assessment (assessment tasks, texts, etc.) Check technical and audio requirements for specific assessments (Scantron Performance Series) Obtain log-in information (FAST & Scantron Performance Series) Locate and review Step 2 for at least one of your EOY MOSL Assessments and review the steps for “Prepare Assessments”. (Refer to P. 8 in the handbook to identify the page for the assessment you’re looking for.)

13 Step 3: Administer Assessments 13 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Each assessment requires different administration steps. Depending on the assessment, specific administration tasks may include the following: Ensure the security of testing materials Follow administration guidelines in the Handbook and or in the assessment system Collect assessment materials. Note: Even if multiple teachers in your school are evaluated on the same assessment, students should only take each assessment once. Locate and review Step 3 for at least one of your EOY MOSL Assessments and review the steps for “Administer Assessments”. (Refer to P. 9 in the handbook to identify the page for the assessment you’re looking for.)

14 Steps 4 and 5: Prepare for Scoring and Score 14 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Scoring Overview: Scoring requirements vary greatly from one assessment to another. Depending on the assessment, specific scoring tasks may include the following: Norm scoring practices (NYC Performance Assessments, FAST, Running Records) Review scoring policies Finalize scoring schedule Coordinate “school-based distributed scoring” for all assessments (except FAST and K-2 Math NYC Performance Assessment) For assessments that do not require distributed scoring, administrators must review and approve assessment results. Approval is indicated on an Assessment Results Approval Form (P. 78). (FAST, K-2 Math Performance Assessment)

15 Steps 4 and 5: Prepare for Scoring and Score 15 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Distributed Scoring: State teacher evaluation law stipulates that teachers with a “vested interest” cannot score the assessments of students they directly teach. Whenever “practicable” schools must establish processes whereby other teachers would score a teacher’s MOSL assessments. Because this scoring policy is not practicable for FAST or K-2 Math NYC Performance Assessments, teachers using these assessments as their MOSL are permitted to score their own students' assessments. The NYCDOE has outlined a process for administrator review of these scores (Assessment Results Approval Form P. 78). 15

16 Steps 4 and 5: Prepare for Scoring and Score 16 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Distributed Scoring- Who is Eligible to Score? It is preferred that assessments be scored by teachers who hold a license in the subject area and/ or are currently teaching the subject area. Principals, APS, Achievement coaches or other network staff may participate in scoring at the discretion of the network and principal. Teachers may score assessments from grades that they are not currently teaching. For example, a 9 th grade ELA teacher may score a 10 th grade ELA assessment. 16

17 Steps 4 and 5: Prepare for Scoring and Score 17 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Scoring Guidelines: In accordance with the state regulations, the DOE recommends that schools choose from one of the following scoring models: Option 1: Teachers in the same grade and subject swap to score end-of-year assessments. Option 2: Teachers of the same subject in different grade levels swap to score end-of-year assessments. Option 3: At the principal’s discretion, teachers who are properly normed in an end-of-year assessment may score. Clusters and networks will establish structures to support schools where the options listed above are not feasible (i.e. schools where there is only one content area teacher for the whole school). 17

18 Steps 4 and 5: Prepare for Scoring and Score 18 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Group Norming Sessions for NYC Performance Assessments*: Schools should conduct norming sessions after administering but before scoring the assessment in order to ensure that all teachers have a common understanding of the rubric and increase fairness of the scoring process. Group norming sessions should follow this process (approx. 2-3 hours): Step 1: Review the rubric and discuss expected performance at each performance level for each rubric trait. Step 2: Review annotated sample student work and discuss the evidence for each score. Step 3: Individually score one EOY assessment, then discuss as a group the evidence for each score. Step 4: Collectively score several students’ NYC Performance Assessments and come to consensus on a score for each trait. The scorer ID for these collectively scored papers can be *Norming scoring practices are also recommended for Running Records and FAST."

19 Steps 4 and 5: Prepare for Scoring and Score 19 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Review the norming steps found on page 32 for the writing prompt, pg. 46 for running recordsin the EOY Assessment Handbook. Why is it so critical that teachers scoring the NYC Performance Assessment are properly normed? Why is this also considered a best practice for Running Records and FAST? Locate and review Steps 4 & 5 for at least one of your EOY MOSL Assessments and review the steps for “Prepare for Scoring & Score”. (Refer to P in the handbook to identify the pages for the assessment you’re looking for.)

20 Step 6: Submit Scores 20 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Submitting Scores- Overview: Scores for different assessments are submitted through different systems. Depending on the assessment, specific submission tasks may include the following: Scan ATS Score Sheets Submit Scores in respective data systems AssessmentPro STARS Classroom SANDI & FAST Online Portal Generate reports and fix errors. Locate and review Step 6 for at least one of your EOY MOSL Assessments and review the steps for “Submit Scores”. (Refer to P. 10 in the handbook to identify the pages for the assessment you’re looking for.)

21 Step 7: Archive Assessment Materials 21 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Sign the MOSL Assessment Material Security Form (P. 72) Archive Assessment Materials It is the responsibility of the school to retain and store all Advance assessment-related materials. Assessments, student work, data collection tools, scanning confirmation pages and Assessment Results Approval Forms should be organized by course and section and stored in an accessible, secured location by the principal, assessment coordinator or designee for a minimum of three years. Locate and review Step 7 for at least one of your EOY MOSL Assessments and review the steps for “Administer Assessments”. (Refer to P. 11 in the handbook to identify the pages for the assessment you’re looking for.)

22 Updates K-2 NYC Performance Test ELA Texts Math Double Testing Waiver for Grade 7 & 8 Students in Accelerated Courses Calendar Change Requests Advance Implementation Funding: SAM 60 Teacher Level Selection Tool 22

23 Activity: Creating an EOY MOSL Implementation Plan 23 Plan for Administration and Scoring Prepare Assessments Administer Assessments Prepare for Scoring Score Submit Scores Archive Assessment Materials Sample MOSL Selections Review the Calendar Planning Tool and the Advance EOY calendar. Begin planning for End-of-Year MOSL assessments at your school. Additional Planning Support: MOSL End-of-Year (EOY) Assessment Analysis and Next Steps Tool  Grade/ Subject Local MeasureState Measures 6-8 ELANYC Performance Assessments – ELA State ELA Tests 6-8 MathState Math Tests (Lowest Third)State Math Tests 6-8 Social Studies NYC Performance Assessments – Social Studies (lowest third) NYC Performance Assessments – Social Studies 6-7 Science NYC Performance Assessments – Science (lowest third) NYC Performance Assessments - Science 8 ScienceNYC Performance Assessments – 8 th Grade Science State Grade 8 Science Test

24 Thank you! Lori Ann O’Connor, Senior MOSL Implementation Specialist Office of Academic Quality, Cluster 6 Office (718) Cell (646)


Download ppt "1 March, 2014 NYC DOE Office of Academic Quality EOY MOSL Assessment Administration and Scoring Process & MOSL Updates."

Similar presentations


Ads by Google