1. SEC State Collaborative Be Inspired, Engaged, Informed Project Planning and Leader Training San Diego February 2008 Surveys of Enacted Curriculum

2. Tools for Aligning Instruction, Standards, & Assessments Orientation for Educators Surveys of Enacted Curriculum

3. New members: Session topics What is SEC? Why? How? -- RB What Collaborative does; Tools --RB SEC online survey system/alignment – Diana Nunnaley How to plan an SEC project – Lani Seikaly How to use SEC data charts– Lisa Palacios

4. Rationale Assessment Standards Curriculum

5. Key Question -- SEC Tools Research into Practice How can Educators obtain reliable, valid data to determine Alignment of instruction with required standards and assessments?

6. Surveys of Enacted Curriculum A neutral content grid with cognitive demand The intended curriculum: State content standards— What students should learn The enacted curriculum: What teachers teach The learned curriculum: Student outcomes based on school learning The assessed curriculum: State (and other) assessments— tested learning

7. Content Matrix

8. School & Class Description Instructional Activities General Problem Solving Activities Pairs & Small Group Work Use of Hands-on Materials Use of Calculators/Computers & other Ed. Tech. Assessment Use Instructional Influences Instructional Readiness Teacher Opinions Professional Development Types, Frequency Content, Active, Collegial, Coherence Instructional Content Topic x Cog. Demand Survey Sections/Uses

9. Steps in SEC Development R&D studies curriculum-- Early ‘90s Models:TIMSS, NAEP, Analyze assessment OTL interest of States, Porter/ Smithson research, CCSSO Science Assessment project State collaborative –Develop surveys-’98-’01 (NSF) 11-State field study, Reports, Alignment, USI Use of data experiment – DEC (NSF/ROLE:‘01-04) Evaluation: MSP RETA PD Study (‘02 – 05, NSF) English/ Language Arts survey (‘03 – 04) Current projects: 15 States, 4 Districts, 5 MSPs

10. Applications Alignment analysis --instruction, standards, assessments Instructional improvement in schools Needs assessment/ Evaluation Indicators – monitoring change over time

11. Multi-State Collaborative  Build Knowledge of leaders  Share Strategies  Produce joint products, tools

12. SEC Collaborative offers Core Components of SEC tools/services 1) Surveys with teachers – report instruction 2) Alignment analysis – content code standards and assessments 3) How to use Data – knowledge, skills 4) Leader development – 2-3 meetings/yr 4) In-state workshops: a) orientation b) use of data

13. SEC Collaborative Members 2007-08 Delaware Idaho Illinois Indiana Iowa Kansas Maine Michigan Mississippi Montana Ohio Oklahoma Oregon Wisconsin SEC ELL Project Minnesota Florida Virginia Utah Plus 5

14. Social Studies SEC Development 2005-2007 Arizona Delaware Idaho Maine Ohio Oregon Vermont Wisconsin Minnesota Nevada U of Wis-WCER NCSS Civics Education National Geographic GENIP NCEE CCSSO

15. SEC Collaborating Organizations Council of Chief State School Officers www.SECsurvey.org www.SECsurvey.org Wisconsin Center for Education Research www.SEConline.orgwww.SEConline.org Learning Point Associates/NCREL www.SECsupport.org www.SECsupport.org TERC Regional Alliance DEC Project www.ra.terc.edu/DEC www.ra.terc.edu/DEC

16. SEC Collaborative States, Districts CCSSO – SEC Collaborative Management Rolf Blank, Carlise Smith WCER – Surveys, Reporting, Alignment analysis John Smithson, Alissa Minor, Eric Osthoff Training & Technical Assistance Carolyn Karatzas, Consultant, CCSSO Diana Nunnaley, TERC Lisa Palacios,Gary Money, Learning Point Associates Lani Seikaly, Hillstreet & Main Jennifer Unger, The Groupworks Deborah Fairington, Michael Erhlinghaus, Measured Progress

17. SEC Websites CCSSO, SEC Collaborative www.SECsurvey.org WCER, SEC Online Survey and Reports www.SEConline.org

18. SEC State Collaborative Be Inspired, Engaged, Informed Project Planning and Leader Training San Diego February 2008 Surveys of Enacted Curriculum

19. SEC by the Numbers: ’06-07 10,393 SEC Surveys 06-07 4674 Math 1993 Science 3646 ELAR 80 Soc Stud 131 Standards/Assess. Content analysis 1000 est. schools--Data use

20. SEC by the Numbers (2) By Comparison 1996 207 Science Teachers (5 states) 1999 626 M/S Teachers (11 states) 2005 5,414 E, M, S teachers 2006 10,200 E, M, S teachers 2007 10,400 E, M, S, SSt (27 states)

21. SEC Collaborative How SEC Collaborative works for members  Training and Assistance to project leaders  Project Planning w/ budget– meet local objectives  Each state/district makes decisions on services & project plan  Multi-state benefits of collaborative e.g., learning from experience, sharing ideas, training

22. Accomplishments 06-07 SEC Collaborative  In-state Leader workshops, Project Planning  PPTs for Orientation, Survey Admin, Data use  Leader Development Standards document  Website revisions, improvements (SECsurvey.org; SEConline.org)  E.g., State Projects, All Alignment results, Report generator

23. More Accomplishments SEC Collaborative  “Using Data to Improve Instruction” Education Leaders conference, St. Louis – 200 leaders, 32 sessions (30 states)  Social Studies Survey development –  10 states, 5 prof. orgs.,  NAEP Alignment analysis – 2007 Math items  Research/evaluation:  MSP study of professional development– multi-site study  Ohio case study of district/school implementation of SEC  Follow-up data tool –to track school level data  Validity study—longitudinal data for teachers and students  Ohio reading study

24. Initiatives SEC 07-08  College Board standards alignment analysis  Iowa SEC ELL Consortium  Webinar Training  Regional Leader Training  Planning—  Summer Meeting/Conference  Work Group products  Coding with States

25. Goals SEC 07-08  State/local projects—From pilots to broad application, local leadership training  Integrate SEC tools/data with Improvement Initiatives, especially data-driven  Research/Evaluation --Broader use of Surveys, Alignment  Assist States in planning with Service delivery agencies; SEC team with CACs & Labs  Social Studies SEC complete & implement

26. View from CCSSO State Opportunities w/ SEC  Alignment –a) Standards-based consequential validity  B) Improving standards in state  Evaluation – connecting with resch/eval in states  Providing local leaders with basic information, then building on it  Montana model  KS Webinar model  Data-driven instructional improvement –relate SEC to other models  E.g. St. Louis conference  Implement through pilot district example – OH, OR  From pilots to broad application, local leadership training  Link SEC to other funded initaitives, ELL, R!, Title I sch improve, MSP  Longitudinal Data Systems (LDS)—enter SEC into systems

27. Questions Addressed by SEC Data How can in-depth data on content of instruction be collected and reported–not topic checklists, to analyze teaching content in relation to standards, assessments, achievement? How can methods of teaching practices be compared across classrooms, schools, districts, and states? How can enacted curriculum data be reported in a manner to encourage use by teachers to improve instruction?

28. MSP PD Study Sites Brockport/Rochester – SUNY Cleveland Municipal SD Corpus Christi – AIMS - TX A&M El Paso – UTEP State MSPs: ID, IL, OR, OK, ME, MT NSF MSPs : Boston NJ MSP -- 12 districts NC MSP -- 17 districts SW PA MSP SCALE – Los Angeles

29. Key Education Questions (cont’d) How can we measure the effects of standards- based initiatives on instructional practices and curriculum in classrooms? How can we analyze effectiveness of professional development on changes in teachers’ instructional practices? (i.e. determine the quality of professional development)

30. What if… [for Intro of SEC to Educators] You could use data on instructional quality and content to guide professional development? You could have consistency across grade levels? You could know how well aligned your state standards were to the state assessment? You could compare how you teach content compared to how others across the nation teach? You could use anonymous teacher data to start a powerful school discussion about what the teacher needs are?

32. Science content matrix

33. Content Maps

34. The Enacted Curriculum