Office Of Standards, Assessment, & Reporting Update David Abrams Assistant Commissioner For Standards, Assessment and Reporting S/CDN September 23, 2004

Utilization of Data CIO Approach: Design of Internal Data Team to Collect & Certify District/Building Data-LEAP/STEP (Database Personnel and Administrators) Review Data for Accountability Purposes: Musser Accountability PowerPoint Data Analysis to Inform Curriculum, Instruction, & Assessment: RICS, BOCES & RSSCs for data analysts to assist & train district staff

Actions To Ensure High Quality Regents Exams Formation of State Assessment Cabinet: Senior Managers from EMSC, VESID, OMS, ITS, Communications, & Office of Counsel Implemented Senior Management Review Implemented Final Eyes Review

Actions To Ensure High Quality Regents Exams Increased Staffing in OSA: 5 Content Specialists, 6 Editors, & 4 Support. Revised Structure & Role for Technical Advisory Group (TAG) Implemented Exam Quality Indictors Designing Standard-Setting Revistation Methodology Implemented Annual Score Collection Process for Statistical Research (June 04: Math B & Chemistry)

Actions To Ensure High Quality Regents Exams Updated Psychometric Validation Procedures: All psychometric work is checked and replicated by multiple groups Implemented Revised Field Testing Procedures: 6 Year Matrix Issued RFPs to Increase Capacity: 3-8 Testing, NYSESLAT, Scaling & Equating, & Scoring & Reporting

Actions To Ensure High Quality Regents Exams Designed & Implemented Electronic State Testing Tracking System Implemented Consultant Inventory Database Designing Electronic Test Ordering System Implemented Regents Testing Cycle Review Meetings Revising Technical Report Manuals

Actions To Ensure High Quality Regents Exams Implemented Math A Panel Recommendations Commissioner Convened Math Standards Committee Implemented Physics Work Group Suggestions Technical Analysis & Comparison of Examination Development Process

Actions To Improve Public Communication Implemented Automated Phone System & Dedicated Box Implemented Regents Examination Website District Superintendents’ Curriculum & Assessment Committee Testing Workshops Assistant Commissioner Outreach to Educational Organizations

GRADE-BY-GRADE ASSESSMENTS REQUIRED UNDER NCLB Contract awarded to CTB/McGraw- Hill for development of English Language Arts and Mathematics tests in Grades 3-8 First administrations in 2006

GRADE-BY-GRADE ASSESSMENT CONTRACT WILL ENCOMPASS THREE CONNECTED ACTIVITIES Test development Test administration Research and psychometric support

TEST DEVELOPMENT PROCESSES Test specifications and frameworks with input from NYS teachers Test construction writing, editing and revising test items Field testing Content Review

TEST DEVELOPMENT PROCESSES TEST DEVELOPMENT PROCESSES (continued) Every effort will be made to limit length of tests, while ensuring that they are valid and reliable. Test designs will reflect knowledge of childhood development.

TEST ADMINISTRATION PROCESSES Forms preparation – including manuals, scoring guides, translations and informational materials Scoring trainings – DVDs and turnkey training Rescoring of 10% sample of operational tests

TEST ADMINISTRATION TEST ADMINISTRATION: POINTS OF INTEREST All ELA tests will be given the same week; all math tests will be given the same week. We are still exploring several scoring models – to maximize effectiveness / timeliness, while minimizing loss of instructional time.

TEST ADMINISTRATION: POINTS OF INTEREST TEST ADMINISTRATION: POINTS OF INTEREST (continued) SED will consult with school/district representatives when developing the testing schedule and scoring models. Informational materials for parents and the public will be produced, in addition to those for teachers and administrators

CURRICULAR IMPLICATIONS English Language Arts tests will be based on existing Core Curriculum. A new Core Curriculum for Mathematics will be developed by Winter based on the recommendations of the Math Standards Committee.

MATH STANDARDS COMMITTEE Summary of Proposed Changes Standard 3 (Mathematics) currently contains seven Key Ideas Proposed Standard 3 would contain - five Content Strands, and - five Process Strands

MATH STANDARDS COMMITTEE Summary of Proposed Changes MATH STANDARDS COMMITTEE Summary of Proposed Changes (continued) Content Strands - Number Sense and Operations - Algebra - Geometry - Measurement - Statistics and Probability

MATH STANDARDS COMMITTEE Summary of Proposed Changes MATH STANDARDS COMMITTEE Summary of Proposed Changes (continued) Process Strands - Problem Solving - Reasoning and Proof - Communication - Connections - Representation

MATH STANDARDS COMMITTEE Summary of Proposed Changes MATH STANDARDS COMMITTEE Summary of Proposed Changes (continued) “Less is more” – content at each grade level will include fewer topics, allowing for more depth Consistent with recent TIMSS recommendations While each grade level will focus on a limited number of topics, previous grades’ process and content will be infused

KEY DATES Regional Forums: Fall 2004 through Spring 2005 Field tests: Spring 2005 Sample tests available: Fall 2005 First operational tests in ELA: January/February 2006 First operational tests in Math: March 2006

Ongoing updates will be provided at: and at A Math Standards website to be created by early October 2004 Questions can be sent to: