Depth of Knowledge Assessments (D.O.K.) Roseville City School District Leadership Team

Depth of Knowledge (D.O.K.) Measures the degree to which the knowledge elicited from students on assessments is as complex as what students are expected to know and do as listed in the state standards.

What Do Depth of Knowledge Assessments Accomplish? DOK assessments are a mechanism to ensure that the intent of the standard and the level of student demonstration required by that standard match. Provides cognitive processing ceiling (highest level students can be assessed) for item development.

Where Did D.O.K. Come From? Developed by Dr. Norman Webb, senior research scientist at the National Institute for Science Education. The Depth of Knowledge conceptual framework forms the basis for development of Common Core Assessments.

How Does D.O.K. Work? Depth of Knowledge is broken into 4 levels. Level One is the most basic level, essentially the “definition” stage. As the levels increase, students must demonstrate increasingly complex mental strategies. Higher levels of DOK require that students solve problems in new and creative ways, and allow for multiple solutions to solve those problems.

Levels of D.O.K. LEVEL ONE - RECALL LEVEL ONE - RECALL Recall of a fact, information, or procedureRecall of a fact, information, or procedure LEVEL TWO – SKILL/CONCEPT LEVEL TWO – SKILL/CONCEPT Use information or conceptual knowledgeUse information or conceptual knowledge LEVEL THREE – STRATEGIC THINKING LEVEL THREE – STRATEGIC THINKING Reasoning, developing a planReasoning, developing a plan LEVEL FOUR – EXTENDED THINKING LEVEL FOUR – EXTENDED THINKING Requires an investigation, collection of data and analysis of resultsRequires an investigation, collection of data and analysis of results

D.O.K. Compared to Bloom’s Bloom’s taxonomy level of difficulty is determined by the verb. DOK’s level of cognitive demand is determined by the context of how the verb is used and the depth of thinking required. Bloom’s taxonomy level of difficulty is determined by the verb. DOK’s level of cognitive demand is determined by the context of how the verb is used and the depth of thinking required. What comes after the verb is more important that the verb itself. What comes after the verb is more important that the verb itself.

Same Verb – Three Different Levels DOK 1 - Describe three characteristics of metamorphic rocks. DOK 1 - Describe three characteristics of metamorphic rocks. DOK 2 – Describe the difference between metamorphic and igneous rocks. DOK 2 – Describe the difference between metamorphic and igneous rocks. DOK 3 – Describe a model you might use to represent he relationship that exists within the rock cycle. DOK 3 – Describe a model you might use to represent he relationship that exists within the rock cycle.

SYNTHESIS AND EVALUATION “Putting together elements & parts to form a whole, then making value judgments about the method.” EXTENDED THINKING Requires an investigation; time to think and process multiple conditions of the problem or task. BLOOM’S TAXONOMYWEBB’S DOK KNOWLEDGE “The recall of specifics and universals, involving little more than bringing to mind the appropriate material ” COMPREHENSION “Ability to process knowledge on a low level such that the knowledge can be reproduced or communicated without a verbatim repetition.” APPLICATION “The use of abstractions in concrete situations.” ANALYSIS “The breakdown of a situation into its component parts.” RECALL Recall of a fact, information, or procedure (e.g., What are 3 critical skill cues for the overhand throw?) SKILL/CONCEPT Use of information, conceptual knowledge, procedures, two or more steps, etc. STRATEGIC THINKING Requires reasoning, developing a plan or sequence of steps; has some complexity; more than one possible answer

D.O.K. is not about difficulty… Difficulty is a reference to how many students answer a question correctly. Difficulty is a reference to how many students answer a question correctly. Same DOK, Different Level of Difficulty Same DOK, Different Level of Difficulty Level 1 DOK - Who is the current President of the United States?Level 1 DOK - Who is the current President of the United States? Level 1 DOK – Who was the 19 th President of the United States?Level 1 DOK – Who was the 19 th President of the United States? DOK 1 + DOK 1 + DOK 1 = DOK 1

D.O.K. is about complexity… The assessment question determines the level of cognitive demand, not the student work.

Which Level Am I? Label locations on a map. Label locations on a map. Design and mathematical model to inform and solve a practical or abstract situation. Design and mathematical model to inform and solve a practical or abstract situation. Identify and summarize the major events, problem, solution and conflicts in a literary text. Identify and summarize the major events, problem, solution and conflicts in a literary text. Analyze the interrelationships among elements of the text (plot, subplots, character, setting). Analyze the interrelationships among elements of the text (plot, subplots, character, setting).

Which Level Am I? Explain, generalize, or connect ideas, using supporting evidence from the text or from other sources. Explain, generalize, or connect ideas, using supporting evidence from the text or from other sources. Locate information to answer questions related to explicit or implicit central ideas in informational texts. Locate information to answer questions related to explicit or implicit central ideas in informational texts. Identify or describe character, setting, and sequence of events. Identify or describe character, setting, and sequence of events. Compare or analyze multiple works from the same time period or same genre. Compare or analyze multiple works from the same time period or same genre.

Resources

Next Steps Begin D.O.K. discussions at your site Begin D.O.K. discussions at your site Present matrix and begin to provide opportunities to articulate around Depth of Knowledge assessments Present matrix and begin to provide opportunities to articulate around Depth of Knowledge assessments Hess Cognitive Rigor MatrixHess Cognitive Rigor Matrix Webb’s Depth of Knowledge LevelsWebb’s Depth of Knowledge Levels Little Red Riding Hood & Cognitive RigorLittle Red Riding Hood & Cognitive Rigor

Next Steps – Leadership Team Review Sample Assessments Review Sample Assessments Reading – 4 thReading – 4 th Reading – 7 thReading – 7 th ELA – 3rd – Constructed ResponseELA – 3rd – Constructed Response ELA – 7 th – Constructed ResponseELA – 7 th – Constructed Response Math – 3 rd – Constructed ResponseMath – 3 rd – Constructed Response Math – 7 th – Constructed ResponseMath – 7 th – Constructed Response

Questions?