Defining Rigor through Research and the Common Core Standards Text Complexity Defining Rigor through Research and the Common Core Standards Audience should have had a general overview of the ELA standards.

Partner Share Take a moment to reflect on what you heard yesterday about the Common Core Standards. Yesterday heard about the organization and structure of the CCSS and vertical articulation. One of the things that we considered yesterday were the six shifts. Today we are going to take a deep dive into one of these shifts, text complexity. But before we move on, let’s take a moment to reflect on some of your key learning from yesterday.

Outcomes Define text complexity and describe why it matters Practice reading complex text and using text-based evidence in discussion Identify implications for our work as school and district leaders By the time you leave today, you will know and be able to Define text complexity and describe why it matters Practice reading complex text and using text-based evidence in discussion Evaluate text complexity of a non-fiction passage Identify implications for our work as school and district leaders

Text Complexity What are some key words you notice in this standard? Specifically, within reading standard #10: Anchor Standard: R.CCR.10 Read and comprehend complex literary and informational texts independently and proficiently. Progression of the Reading Standard 10 - Appendix A, page 10 What are some key words you notice in this standard? Note on range and content of student reading Anchor standard 10 specifically calls out text complexity for both literary and informational text. To build a foundation for college and career readiness, students must read widely and deeply from among a broad range of high-quality, increasingly challenging literary and informational texts. Through extensive reading of stories, dramas, poems, and myths from diverse cultures and different time periods, students gain literary and cultural knowledge as well as familiarity with various text structures and elements. By reading texts in history/social studies, science, and other disciplines, students build a foundation of knowledge in these fields that will also give them the background to be better readers in all content areas. Students can only gain this foundation when the curriculum is intentionally and coherently structured to develop rich content knowledge within and across grades. Students also acquire the habits of reading independently and closely, which are essential to their future success. We are not just talking about comprehension, we are specifically calling out complex text. Take a moment to notice how text complexity is articulated on page 10 of Appendix A. What are some key words you notice in this standard?

Protocol – part 1 Read Appendix A, pages 2, 3 and top half of 4 Identify a passage that you feel has implications for your work Identify a back up passage The purpose of the next activity we are about to launch is to examine why text complexity matters and to give you a chance to experience using text based evidence in discussions about reading, one of the six major shifts which are called for in the CCSS. I’d like for your to read Appendix A, pages 2, 3 and the top half of page four. As you read, select one passage and a back up passage in case someone else in your groups comes up with the same idea, that you think has implications for your work.

Three Levels of Text Protocol Form a group of three people Identify a time keeper and a facilitator One person has up to three minutes to: Level 1- read the passage you selected aloud Level 2 – tell about what he/she thinks about the passage Level 3 – Tell about what implications for his/her work The group responds for up to two minutes Repeat steps 3 and 4 until everyone has shared their passage. The structure that we will use to help facilitate a discussion based on evidence from the text is the Three Levels of text protocol. Given the short amount of time we have, it will be important to work in groups of three. I have found that this protocol is most successful when there is a time keeper who helps the group work within the suggested timeframe and a facilitator to ensure that everyone has a chance to speak. We will have 15 minutes for this protocol. 3 minutes for each person to talk about their passage, and 2 minutes for group members to respond. So if there are three people in each group, this will take us 15 minutes.

Debrief the process In what ways did this protocol support the use of text-based questions and answers? http://vimeo.com/27251914 Are there any reactions to the text that you would like to bring fourth to the whole group? In what ways did this protocol support the use of text-based questions and answers? This protocol required you: to read complex text, have rich discussions dependent on common text, make text based connections, use evidence based arguments in discussion. This is the the level of rigor that the CCSS require of our students. .

Overview of Text Complexity Text complexity is defined by: Quantitative Quantitative measures – readability and other scores of text complexity often best measured by computer software. Qualitative Qualitative measures – levels of meaning, structure, language conventionality and clarity, and knowledge demands often best measured by an attentive human reader. Reader and Task Reader and Task considerations – background knowledge of reader, motivation, interests, and complexity generated by tasks assigned often best made by educators employing their professional judgment. There are three equally important considerations when measuring text complexity. The qualitative, the quantitative, and the reader and task considerations. We will look at each of these considerations individually

Where do we find texts in the appropriate text complexity band? We could... Choose an excerpt of text from Appendix B: Use available resources to determine the text complexity of other materials on our own. or… To determine text complexity we might consider the exemplar texts from Appendix B of the standards. Of course, excerpts from Appendix B which of course consider the qualitative and quantitative aspects of the equation but not the reader and task considerations from the equation or alternatively, we might use a few of the tools and make a determination ourselves. Take a moment to check out Appendix B. Select a grade level that you are familiar with. What texts do you see that you currently use, which texts represent a different level of rigor? These texts are not an exhaustive list, simply a few examples to give us an understanding of the levels of complexity for the grade level.

Determining Text Complexity A Four-step Process: Determine the quantitative measures of the text. Qualitative Quantitative Analyze the qualitative measures of the text. Reflect upon the reader and task considerations. Reader and Task Overview of the protocol. Determining text complexity is a four step process. We will go through each of these steps with an example. Recommend placement in the appropriate text complexity band.

Step 1: Quantitative Measures Measures such as: Word length Word frequency Word difficulty Sentence length Text length Text cohesion Let’s look first at the quantitative measure. We are familiar with a number of quantitative measures such as lexiles, AR levels and others. Quantitative measures consider things such as word length, frequency of word use, difficult of words, sentence length, text length.

Lexile Rangle Aligned to the CC Standards Lexiles The Quantitative Measures Ranges for Text Complexity Gr. Band Old Lexile Lexile Rangle Aligned to the CC Standards K - 1 N/A 2 – 3 450 - 725 450 – 790 4 – 5 645 - 845 770 – 980 6 – 8 860 – 1010 955 – 1155 9 – 10 960 - -1115 1080 – 1305 11 - CCR 1070 – 1220 1215 - 1355 One important note is that the Common Core Standards have called for higher levels of rigor. You will see slight upward changes in the ranges for each grade level. Where do we see the greatest upwards shift?

Step 1: Quantitative Measures Let’s imagine we want to see where a text falls on the quantitative measures “leg” of the text complexity triangle, using the Lexile text measures. For illustrative purposes, let’s choose Harper Lee’s 1960 novel To Kill a Mockingbird. As we consider text complexity, we will use a popular novel used in many ELA courses as an example.

Step 1: Quantitative Measures Finding a Lexile Measure for Text: http://www.lexile.com/findabook/ One tool that is available at Lexile.com is a look up feature where you can search a database for texts.

Step 1: Quantitative Measures After entering the title, we see that To Kill A Mockingbird is at a 870 lexile level.

Quantitative Measures Ranges for Text Complexity Grade Bands Kansas Common Core Standards Quantitative Measures Ranges for Text Complexity Grade Bands Text Complexity Grade Bands Suggested Lexile Range Suggested ATOS Book Level Range** K-1 100L – 500L* 1.0 – 2.5 2-3 450L – 790L 2.0 – 4.0 4-5 770L – 980L 3.0 – 5.7 6-8 955L – 1155L 4.0 – 8.0 9-10 1080L – 1305L 4.6 – 10.0 11-CCR 1215L – 1355L 4.8 – 12.0 In which grade band does the 870 lexile for To Kill A Mockingbird Fall? * The K-1 suggested Lexile range was not identified by the Common Core State Standards and was added by Kansas. ** Taken from Accelerated Reader and the Common Core State Standards, available at the following URL: http://doc.renlearn.com/KMNet/R004572117GKC46B.pdf

Step 1: Quantitative Measures 870L Lexile Text Measure: ATOS Book Level 5.6 Looking at another quantitative metric, AR, we see that the level is 5.6. Do continue to use the tool that you are familiar with or your district uses. A recent study found there was no one tool that was superior.

Step 1: Quantitative Measures For texts not in the Lexile database, consider using the Lexile Analyzer: http://www.lexile.com/analyzer/ Registration is required (free) http://www.lexile.com/account/register/ Allows user to receive an “estimated” Lexile score Accommodates texts up to 1000 words in length Texts of any length can be evaluated using the Professional Lexile Analyzer—educators can upgrade to this tool for free by requesting access http://www.lexile.com/account/profile/access/ For texts that are not in the Lexile Database, there is a text analyzer tool in which you can take any document saved in .txt format and determine the lexile level. This is a free application and is available online.

Step 2: Qualitative Measures Measures such as: Levels of meaning Levels of purpose Structure Organization Language conventionality Language clarity Prior knowledge demands Now that we have looked at the quantitative considerations, let’s turn to the qualitative measures. In the past, we have attended to this, but not necessarily in the structured manner in which the CCSS suggest.

Step 2: Qualitative Measures The Qualitative Measures Rubrics for Literary and Informational Text: The rubric for literary text and the rubric for informational text allow educators to evaluate the important elements of text that are often missed by computer software that tends to focus on more easily measured factors. Qualitative measures look at important elements of the tests that are often missed by computer software which focus on the sorts of things that are quantifiable such as levels of meaning or purpose, the structure, language, prior knowledge, experiences, references to other cultures or texts, and content. We have included for you a rubric for both literary and informational texts that helps us to analyze the qualitative measures. Take a moment to peruse these tools. Because the factors for literary texts are different from information texts, these two rubrics contain different content. However, the formatting of each document is exactly the same. And because these factors represent continua rather than discrete stages or levels, numeric values are not associated with these rubrics. Instead, four points along each continuum are identified: high, middle high, middle low, and low.

Partner Share How do the demands for text complexity increase from low to high? Take a moment to peruse these tool. What are some of the key differences from low to high text complexity?

Step 2: Qualitative Measures Users read across the four columns for each row of checkboxes on the rubric, identifying which descriptors best match the text by marking a particular checkbox. As Appendix A states, “Few, if any, authentic texts will be low or high on all of these measures.” The goal is not for all of the checkmarks to be in a single column; the goal is to accurately reflect these factors of the text. The marked rubric can then serve as a guide as educators re-evaluate the initial placement of the work into a text complexity band. Such reflection may validate the text’s placement or may suggest that the placement needs to be changed. In fact, this marked rubric represents the evaluation of To Kill a Mockingbird completed by a committee of teachers.

Step 2: Qualitative Measures From examining the quantitative measures, we knew: 870L Lexile Text Measure: 5.6 ATOS Book Level: But after reflecting upon the qualitative measures, we believed: After reflecting on qualitative measures, we find that the 9th and 10th grade band is probably where this text falls. After reflecting on qualitative measures, we find that the 9th and 10th grade band is probably where To Kill a Mockingbird falls. Our initial placement of To Kill a Mockingbird into a text complexity band changed when we examined the qualitative measures. Remember, however, that we have completed only the first two legs of the text complexity triangle. The reader and task considerations still remain.

Step 3:Reader and Task Considerations Considerations such as: Motivation Knowledge and experience Purpose for reading Complexity of task assigned regarding text Complexity of questions asked regarding text The third consideration is the reader and task. By this we mean, the motivation level, knowledge and experience, purpose for reading, complexity of the task and the questions a student might be required to respond to.

Step 3:Reader and Task Considerations The questions included here are largely open-ended questions without single, correct answers, but help educators to think through the implications of using a particular text in the classroom. In your packet is a handout on Reader and Task Considerations. The questions included here are largely open-ended questions without single, correct answers, but help educators to think through the implications of using a particular text in the classroom. Take a moment to read the handout on Reader and Task Considers. I’d like for you to practice Anchor Standard 2 – Summarize key ideas that need to be considered.

An example of a completed template for To Kill a Mockingbird from Kansas. Let’s read what was said about to Kill a Mockingbird.

Step 4: Recommended Placement Based upon all the information—all three legs of the model—the final recommendation for To Kill a Mockingbird is…. Based upon all three legs of the model, the most appropriate placement for the novel was grades 9-10.

Step 4: Recommended Placement In this instance, Appendix B confirms our evaluation of the novel. To Kill a Mockingbird is placed within the grade 9-10 text complexity band. Validating our analysis, the Common Core Standards List of Exemplar Texts (Appendix B) came to this same conclusion.

Step 4: Recommended Placement Template for Text Complexity Analysis and Recommended Placement Form: The one-page template provides an opportunity to record the thinking involved in recommending the placement of a specific text into a text complexity band. Keeping a record of such analysis and thinking might be useful documentation in the case that any questions arise in the future. Once the recommended placement has been decided upon, educators might also find it useful to document some the thinking that led them to their conclusion.

Evaluate a text Using the Surface Tension selection from the Foss Water Unit, evaluate the text complexity. Use the four-step process to make a placement recommendation What level is this text? Now you will have an opportunity to evaluate a piece of informational text. In your handouts is a selection from the Foss Water Unit. I’d like for you to use the four step process to evaluate the Complexity of the text. You may try out the text analyzer at Lexile.com if someone in your group has a computer. Otherwise, I am happy to provide the Lexile to you.

Surface Tension Article What did you find in your analysis

Implications What are some implications for your school or district as you consider the levels of text complexity called for in the Common Core Standards? Table talk

Building Capacity How will you share the your new learnings about Common Core back to your building or district? Table Talk

Wrap Up Exit Ticket Feedback Form Clock Hours

Clock Hours Title: ELA Common Core Standards Class # - SEB655 First Day: May 15 Total Hours: 9 Cost – $18 Check, Visa or Mastercard only Card #, Expiration Date, csc #, (add to bottom of form) Don’t have $ today? Send to ESD within 3 weeks

Research Base ACT, INC. Report (2006) Common Core State Standards (2010) National Reading Panel Report (2000) Publishers’ Criteria for the Common Core State Standards in English Language Arts and Literacy Grades K-2 and Grades 3-12 (2011) RAND Report: Reading for Understanding: Toward an R&D Program in Reading Comprehension (Snow, 2002) Reading in the Disciplines: The Challenge of Adolescent Literacy (Lee & Spratley, 2010)