1. An Orientation of the Surveys of the Enacted Curriculum Ohio ELL Project Carolyn Karatzas Technical Assistance Provider SEC ELL Grant

2. Questions that will be addressed… What are the Survey of Enacted Curriculum tools? Why are SEC data useful to educators? How are data collected, analyzed, reported?

3. What are the Surveys of Enacted Curriculum and why do educators use them?

4. Survey- Defined 1 a: to examine as to condition, situation, or value : appraise b: to query (someone) in order to collect data for the analysis of some aspect of a group or area www.merriam-webster.com 1.to examine for some specific purpose; inspect or consider carefully; review in detail2.to look at or consider, esp. in a general or comprehensive way; view www.yourdictionary.com

5. The Surveys of Enacted Curriculum-Defined An educational tool to examine, inspect or consider the instructional content and practices used by teachers The data or information from the SEC provides a vehicle for discussion among teachers about their collective instruction Provides the individual teacher with information about their specific instruction to state standards

6. The Surveys of Enacted Curriculum are a research-based, data analysis tool for analyzing the content of state standards and assessments online, web-based surveys that collect teacher reported information about what content they teach and what instructional practices they use in one class graphed reports representing the data collected from teacher surveys and coding.

7. How many educators are using the Surveys of Enacted Curriculum? 10,393 teachers took a Survey of Enacted Curriculum in the 2006-07 school year 4674 Math 1993 Science 3646 ELAR 80 Soc Stud 131 standards and assessments were coded.

8. How many educators in OHIO are using the Surveys of Enacted Curriculum? 1,612 teachers took a Survey of Enacted Curriculum in the 2006-2007school year 239 Math 41 Science 1327 ELAR 5 Soc Stud So far about 800 teachers this school year!

9. Why are educators using the Surveys of Enacted Curriculum?

10. Could you improve student achievement if you had answers to these questions? How do I know that what teachers are teaching is aligned with what students are expected to learn as identified by state standards? How do I know that teachers are spending instructional time on the right things? What do I know about our instructional program in a low performing area? Are our instructional practices consistent with research on effective practices? What professional development do my teachers need?

11. Could you improve student achievement if you had answers to these questions? Am I teaching what students are expected to learn? Am I spending my instructional time on the right things? Are my instructional practices consistent with research on effective practices? What professional development do I need?

12. Enacted (3 rd Grade Teacher Reports)Intended (3 rd Grade Math Indicators)

13. Enacted (9 th Grade Teacher Reports)Intended (9 th Grade Indicators)

14. Enacted (3 rd Grade Teacher Reports)Intended (3 rd Grade Math Indicators)

15. SEC Online reports instructional content using tile charts. Drop-down menus allow you to select grade-specific and course-specific results for your school, district and state, in addition to reports of your own results.

16. A teacher’s own results.

17. How do the surveys work? Content specialists code the standards and assessments Teachers take an online survey about what they teach, how they teach it and what professional development they have had

18. Content Descriptions Content Descriptions Alignment Analyses Needs Assessment Program Evaluation Monitoring Change Curriculum Management Teacher Reports Content Analyses SEC Taxonomy

19. Ohio is one of nine states to participate in the SEC - ELL Grant, an enhanced assessment grant awarded by the U.S. Department of Education to CCSSO and a consortium of states to better understand and support the achievement of English Language Learners.

20. In too many schools, English Language Learners are a subgroup whose performance is not meeting the AYP targets. Schools, districts, and states across the country are trying to find answers to how to best provide access to and support ELL students in attaining state standards and NCLB targets.

21. This SEC ELL Study is addressing the following questions: To what extent do ELL’s have opportunity to learn academic content and skills in state standards? What is relationship of state ELD standards and assessments to state academic standards? What instructional practices/strategies are used to teach English language skills across content areas? What is relationship of alignment of instruction (to standards) with student achievement?

22. What can Ohio educators gain from participating in the Surveys?

23. School and district leaders can… Identify the extent to which instruction is aligned to state standards and assessments Understand what instructional activities and strategies are being used in classrooms Compare the strategies used in classrooms with ELL students to strategies used in classrooms without ELL students.

24. School and district leaders can… Identify the extent to which language proficiency standards are aligned to language proficiency assessments Identify alignment of language complexity and demand in content standards Identify priority needs for professional development

25. Teachers can… Identify the extent to which what they teach is aligned with state standards and assessments Better understand what they need to be teaching more or less See how their instructional practices compare to other teachers in their school or district Identify the language complexity and demand of the standards they teach Identify priority needs for professional development

26. What is your role in this project? What is the state’s role?

27. The State’s Role … To participate in a nine state collaborative with CCSSO (Council for Chief State School Officers) and WCER (Wisconsin Center for Educational Research) to identify study questions, implement the survey in their respective states, and analyze the results. To identify which districts will participate in taking the survey, the target number of participants and content areas and grade levels that will be included in the project. To coordinate the coding of selected state content standards and the language proficiency standards for their state and send content and linguistic specialists to participate in the coding workshops.

28. Your role … participate in taking the survey and the timeframe for completion Attend an orientation presentation Take the survey Attend training on how to read and interpret the data results from the survey Have discussions using your data results

29. Administering the Surveys: What is involved?

30. Online Survey Administration www.seconline.org Approximately 90-120 minutes to complete (depending on which surveys) May be completed in multiple sittings Data is saved as each section is completed Teachers may use their planning book or calendar

31. Step 1: Report time spent on topics taught Reporting Instructional Content Review the list of topics presented for the current Content Area. For each topic in the list that is taught to the target class, select a radio button corresponding to 1,2, or 3 based on the following definitions: 0 = Not covered 1 = Less than 1 lesson 2 = 1-5 lessons 3 = more than 5 lessons

32. Step 2: Set expectations for students for each topic taught. Reporting Instructional Content For each topic selected from the previous screen set the cognitive expectations for students for each of 5 categories of cognitive demand, using the following definitions 0 = No emphasis 1 = Slight emphasis 2 = Moderate emphasis 3 = Sustained emphasis Focus on target class & reporting period.

33. ELL-Reporting Instructional Content

34. Editing Results Survey Completion Completed survey sections may be reviewed/edited until: 1)The survey completion window has closed 2)You review results for a given survey section To review/edit responses: Check the box on the Survey Menu Screen next to the section you want to review/edit. (Completed sections will be identified by green text.)

35. Online Report Generator Reviewing Results ELL data will be available Early Fall

36. What do you need to know about taking the survey? What do you need to know to be able to do a good job taking the survey? Where and when will you take the survey? What do you need to bring? What data will you receive after they take the survey? How will your confidentiality be protected? Are there any additional incentives for your participation?

37. Who should you contact for additional information? At the state…. Dan Fleck Dan.Fleck@ode.state.oh.us Sue Mash Sue.Mash@ode.state.oh.us Christopher Woolard Christopher.woolard@ode.state.oh.us At CCSSO … Carolyn Karatzas, Technical Assistant 603.231.8534 carolyn@ekaratzas.com carolyn@ekaratzas.com