Using Data to Improve Instruction: Building on Models that Work Council of Chief State School Officers St. Louis September 12-14, 2007 Education Leaders.

Slides:



Advertisements
Similar presentations
Current Instruction, Common Core, Assessments Where are the Gaps? Rolf K. Blank, CCSSO, 6/21/13 Question: Where should the emphasis in teacher PD with.
Advertisements

Title I Directors Conference Sept 2007 Carol Diedrichsen Gwen Pollock Surveys of the Enacted Curriculum for English.
Aligning Instruction to Standards and Assessments for English Language Learners Meeting # 3 Aug U.S. Department of Education, Title I, Enhanced.
1 Literacy PERKS Standard 1: Aligned Curriculum. 2 PERKS Essential Elements Academic Performance 1. Aligned Curriculum 2. Multiple Assessments 3. Instruction.
© 2004 CCSSO ALL RIGHTS RESERVED. Findings on Alignment of Instruction using Enacted Curriculum Data Rolf K. Blank Director, Education Indicators
August 2006 OSEP Project Director's Conference 1 Preparing Teachers to Teach All Children: The Impact of the Work of the Center for Improving Teacher Quality.
Determining Validity For Oklahoma’s Educational Accountability System Prepared for the American Educational Research Association (AERA) Oklahoma State.
Common Core State Standards OVERVIEW CESA #9 - September 2010 Presented by: CESA #9 School Improvement Services Jayne Werner and Yvonne Vandenberg.
Building & Using an Effective Leadership Team Kathi Cooper Aida Molina Bette Harrison Sandy Lam.
Going Virtual with Surveys of the Enacted Curriculum.
1 Why is the Core important? To set high expectations – for all students – for educators To attend to the learning needs of students To break through the.
1 Reading First Internal Evaluation Leadership Tuesday 2/3/03 Scott K. Baker Barbara Gunn Pacific Institutes for Research University of Oregon Portland,
A Project Sponsored by the McCormick Foundation Lisa Hood, LINC Project Director Center for the Study of Education Policy Illinois State University Presentation.
Common Core State Standards & Assessment Update The Next Step in Preparing Michigan’s Students for Career and College MERA Spring Conference May 17, 2011.
Iowa Department of Education SEC – ELL April 21, 2008 Welcome.
Introduction to Surveys of Enacted Curriculum Tools for School Improvement Oregon SEC Collaborative SEC 101a.
Aligning Instruction to Standards and Assessments for English Language Learners (Meeting #1) U.S. Department of Education, Title I, Enhanced Assessment.
SEC State Collaborative Be Inspired, Engaged, Informed Project Planning and Leader Training San Diego February 2008 Surveys of Enacted Curriculum.
1. 2 Why is the Core important? To set high expectations –for all students –for educators To attend to the learning needs of students To break through.
Longitudinal Study to Measure Effects of MSP Professional Development on Improving Math and Science Instruction: Year 3 Update Report MSP-RETA Project.
Aligning the P-16 Curriculum to Improve Science Teacher Preparation Michael Odell, Ph.D. John Ophus, Ph.D. Teresa Kennedy, Ph.D. Jason Abbitt, Ph.D. Kristian.
Focusing on Our English Language Learners in Virginia Lani Hall Seikaly Technical Assistance Provider SEC ELL Grant An Orientation to The Surveys of Enacted.
Content Analysis of Common Core State Standards: Initial Findings Webex: September 20, 2010.
An Orientation of the Surveys of the Enacted Curriculum Ohio ELL Project Carolyn Karatzas Technical Assistance Provider SEC ELL Grant.
MCC PTA September 28, 2010 Chris Minnich, CCSSO. Common Core State Standards Initiative  Why Common Core?  Adoption status  High-level implementation.
Longitudinal Study to Measure Effects of MSP Professional Development on Improving Math and Science Instruction.
1 Longitudinal student data is data that allows the user to match individual student records across datasets and years. What is Longitudinal Student Data?
Tools for Aligning Instruction, Standards, & Assessments St. Paul, MN August 5, 2009 Rolf K. Blank Surveys of Enacted Curriculum.
What if… You could use data to guide professional development? You could have consistency across grade levels? You could know how well aligned your state.
SEC Survey Administrators’ Training and Teacher Orientation Presenter Name Presenter Title Month and Year.
Copyright © 2008 Learning Point Associates. All rights reserved. Surveys of the Enacted Curriculum Cary Cuiccio Lisa Palacios March 6, 2009.
] Using Data to Improve Instruction: Building on Models that Work St. Louis, MO Professional Development Model Using the Surveys of Enacted Curriculum.
SEC Training and Teacher Orientation for Taking the Surveys Online Put date here Oregon SEC Collaborative SEC 201.
The Next Generation Science Standards From Awareness to Transition
The Center on Innovations in Learning (CIL ) A National Content Center Content Center Presentation January 31, 2014.
Science Education Updates from the Council of Chief State School Officers March 8, 2011 David Heil CCSSO Senior Science Advisor, CCSSO Math and Science.
Focusing on Our English Language Learners in Florida Lani Hall Seikaly Technical Assistance Provider SEC ELL Grant An Orientation to The Surveys of Enacted.
An Orientation to The Surveys of Enacted Curriculum Wisconsin ELL Project Carolyn Karatzas Technical Assistance Provider SEC ELL Grant.
CALIFORNIA DEPARTMENT OF EDUCATION Tom Torlakson, State Superintendent of Public Instruction Enhanced Assessment Grant: English Language Proficiency Assessment.
Using Curricular Measures for Description & Analysis SEC Collaborative Meeting Tampa, FL February 21, 2005 John L. Smithson, Director, Measures of Enacted.
In Search of Standards-aligned Instruction Update on S.E.C. in Delaware Mike Stetter Director of Curriculum Delaware Department of Education September.
Integrated Document Analysis Workshop Peter Worth, Assessment Standards & Development Services, WestEd, CA John L. Smithson, Director, Measures of the.
Goals for Webinar: Applications of SEC Alignment Analysis
What if… You could use data to guide professional` development? You could have consistency across grade levels? You could know how well aligned your state.
Introduction to Surveys of Enacted Curriculum Presentation: Introduce SEC to Educators [Enter place and date]
BAIP Blending Assessment with Instruction Program Bill Biermann Assistant Executive Director SWPRSC
Data Report July Collect and analyze RtI data Determine effectiveness of RtI in South Dakota in Guide.
© 2005 CCSSO ALL RIGHTS RESERVED. Tools for Aligning Instruction, Standards, & Assessments SEC Project Planning & Leader Training February 2005 SEC State.
SEC on School Improvement Lani Seikaly CCSSO Consultant.
Transition to Instruction with the Common Core State Standards: What do Educators need to know? Online Professional Development Series March – April, 2012.
Survey of Enacted Curriculum— © 2004 CCSSO All rights reserved. Surveys of Enacted Curriculum: An Introduction to Accessing and.
School Accreditation School Improvement Planning.
STEM MI Champions SURVEYS OF ENACTED CURRICULUM Teacher Orientation Gary Money August 2 and 3, 2011.
Florida Charter School Conference Orlando, Florida November, 2009 Clark Dorman Project Leader Florida Statewide Problem-Solving/RtI Project University.
Content Analysis Workshop John L. Smithson, Director, Measures of the Enacted Curriculum Alissa Minor, Projects Manager, Measures of the Enacted Curriculum.
“ Public education is open to all children - no matter their ability, heritage, or economic background. It is the promise of our future ” Denise Juneau,
1 Assuring the Quality of Data from the Child Outcomes Summary Form.
Alignment as a Systemic Tool Classroom Instruction.
What if… You could use data to guide professional development? You could have consistency across grade levels? You could know how well aligned your state.
NGSS Resources Facilitator Notes:
Common Core State Standards for Mathematics (CCSSM):
Education Leaders Conference: Using Data to Improve Instruction
Phyllis Lynch, PhD Director, Instruction, Assessment and Curriculum
Using Curricular Measures for Description & Analysis
Statewide System of Support Foundational Services April 2015 Illinois State Board of Education In Collaboration with Regional Offices of Education/Intermediate.
Understanding Cognitive Demand
Introduction to the SEC
SEC & State/District Initiatives
Continuous Assessment Establishing Checkpoints
Presentation transcript:

Using Data to Improve Instruction: Building on Models that Work Council of Chief State School Officers St. Louis September 12-14, 2007 Education Leaders Conference

Tools for Aligning Instruction, Standards, & Assessments Orientation for Educators Surveys of Enacted Curriculum

Conference Objectives  Present & discuss: Strategies/designs/tools for using data to improve instruction– that have been applied with schools  Analyze findings/evidence about effectiveness of strategies/designs/tools, and discuss potential as model for others  Provide leadership training on how to implement and use data-driven approaches for improving instruction

Panel of State Leaders: Policy to Practice Question— How can States effectively integrate Education Improvement Initiatives with Use of Data? How can States effectively integrate Education Improvement Initiatives with Use of Data? PANEL Gene Wilhoit Gene Wilhoit, CCSSO Executive Director, (Facilitator) Gerald Zahorchak, Pennsylvania Secretary of Education Susan Castillo, Oregon Superintendent of Education Todd Flaherty, Rhode Island Department of Education Sally Wherry, Minnesota Department of Education

New members: Session topics What is SEC? Why? How? -- RB What Collaborative does; Tools --RB How to use SEC data charts– Carolyn Karatzas How to plan an SEC project – Diana Nunnaley SEC online survey system/alignment – John Smithson

New Member Orientation What? … are the Survey of Enacted Curriculum tools? How?… are data collected, analyzed, reported? Why?… are SEC data useful to educators, leaders, researchers? Now what?…how do we implement locally and lead the use of SEC in schools?

STATE of MissourA MissourEE

SEC State Collaborative Members Planning Meeting St. Louis September 11, 2007 Surveys of Enacted Curriculum

Rationale Assessment Standards Curriculum

Applications Alignment analysis --instruction, standards, assessments Instructional improvement in schools Needs assessment/ Evaluation Indicators – monitoring change over time

Multi-State Collaborative  Build Knowledge of leaders  Share Strategies  Produce joint products, tools

SEC Collaborative Members Delaware Idaho Illinois Indiana Iowa Kansas Maine Michigan Mississippi Montana Ohio Oklahoma Oregon Wisconsin Vermont* Minnesota*

Social Studies SEC Development Arizona Delaware Idaho Maine Ohio Oregon Vermont Wisconsin Minnesota Nevada U of Wis-WCER NCSS Civics Education National Geographic GENIP NCEE CCSSO

SEC Collaborating Organizations Council of Chief State School Officers Wisconsin Center for Education Research Learning Point Associates/NCREL TERC Regional Alliance DEC Project

SEC Collaborative offers Core Components of SEC tools/services 1) Surveys with teachers – report instruction 2) Alignment analysis – content code standards and assessments 3) How to use Data – knowledge, skills 4) Leader development – 2-3 meetings/yr 4) In-state workshops: a) orientation b) use of data

SEC Collaborative States, Districts CCSSO – SEC Collaborative Management Rolf Blank, Carlise Smith WCER – Surveys, Reporting, Alignment analysis John Smithson, Alissa Minor, Eric Osthoff Training & Technical Assistance Carolyn Karatzas, Consultant, CCSSO Diana Nunnaley, TERC Gary Money, Maren Harris, Learning Point Associates Lani Seikaly, Hillstreet & Main Jennifer Unger, The Groupworks Michael Erhlinghaus, Measured Progress

SEC by the Numbers: ’ ,393 SEC Surveys Math 1993 Science 3646 ELAR 80 Soc Stud 131 Standards/Assess. Content analysis 1000 est. schools--Data use

SEC by the Numbers (2) By Comparison Science Teachers (5 states) M/S Teachers (11 states) ,414 E, M, S teachers ,200 E, M, S teachers ,400 E, M, S, SSt (27 states)

SEC Collaborative How SEC Collaborative works for members  Training and Assistance to project leaders  Project Planning w/ budget– meet local objectives  Each state/district makes decisions on services & project plan  Multi-state benefits of collaborative e.g., learning from experience, sharing ideas, training

Accomplishments SEC Collaborative  In-state Leader workshops, Project Planning  PPTs for Orientation, Survey Admin, Data use  Leader Development Standards document  Website revisions, improvements (SECsurvey.org; SEConline.org)  E.g., State Projects, All Alignment results, Report generator

More Accomplishments SEC Collaborative  “Using Data to Improve Instruction” Boulder, CO conference – 200 leaders, 32 sessions (30 states)  Social Studies Survey development –  10 states, 5 prof. orgs.,  NAEP Alignment analysis – 2007 Math items  Research/evaluation:  MSP study of professional development– multi-site study  Ohio case study of district/school implementation of SEC  Follow-up data tool –to track school level data  Validity study—longitudinal data for teachers and students  Ohio reading study  John demonstrated SEC comparisons in Feb 07

Goals SEC  State/local projects—From pilots to broad application, local leadership training  Integrate SEC tools/data with Improvement Initiatives, especially data-driven  Research/Evaluation --Broader use of Surveys, Alignment  Assist States in planning with Service delivery agencies; SEC team with CACs & Labs  Social Studies SEC complete & implement

Key Question -- SEC Tools Research into Practice How can Educators obtain reliable, valid data to determine Alignment of instruction with required standards and assessments?

School & Class Description Instructional Activities General Problem Solving Activities Pairs & Small Group Work Use of Hands-on Materials Use of Calculators/Computers & other Ed. Tech. Assessment Use Instructional Influences Instructional Readiness Teacher Opinions Professional Development Types, Frequency Content, Active, Collegial, Coherence Instructional Content Topic x Cog. Demand Survey Sections

Steps in SEC Development R&D studies curriculum-- Early ‘90s Models:TIMSS, NAEP, Analyze assessment OTL interest of States, Porter/ Smithson research, CCSSO Science Assessment project State collaborative –Develop surveys-’98-’01 (NSF) 11-State field study, Reports, Alignment, USI Use of data experiment – DEC (NSF/ROLE:‘01-04) Evaluation: MSP RETA PD Study (‘02 – 05, NSF) English/ Language Arts survey (‘03 – 04) Current projects: 15 States, 4 Districts, 5 MSPs

Questions Addressed by SEC Data How can in-depth data on content of instruction be collected and reported–not topic checklists, to analyze teaching content in relation to standards, assessments, achievement? How can methods of teaching practices be compared across classrooms, schools, districts, and states? How can enacted curriculum data be reported in a manner to encourage use by teachers to improve instruction?

MSP PD Study Sites Brockport/Rochester – SUNY Cleveland Municipal SD Corpus Christi – AIMS - TX A&M El Paso – UTEP State MSPs: ID, IL, OR, OK, ME, MT NSF MSPs : Boston NJ MSP districts NC MSP districts SW PA MSP SCALE – Los Angeles

Key Education Questions (cont’d) How can we measure the effects of standards- based initiatives on instructional practices and curriculum in classrooms? How can we analyze effectiveness of professional development on changes in teachers’ instructional practices? (i.e. determine the quality of professional development)

What if… [for Intro of SEC to Educators] You could use data on instructional quality and content to guide professional development? You could have consistency across grade levels? You could know how well aligned your state standards were to the state assessment? You could compare how you teach content compared to how others across the nation teach? You could use anonymous teacher data to start a powerful school discussion about what the teacher needs are?

Content Matrix

Science content matrix

Content Maps

Surveys of Enacted Curriculum A neutral content grid with cognitive demand The intended curriculum: State content standards— What students should learn The enacted curriculum: What teachers teach The learned curriculum: Student outcomes based on school learning The assessed curriculum: State (and other) assessments— tested learning

The Enacted Curriculum

SEC Websites CCSSO, SEC Collaborative WCER, SEC Online Survey and Reports