Presentation on theme: "Practical Strategies for Student Metacognition"— Presentation transcript:
1 Practical Strategies for Student Metacognition Technology, Innovations, & Pedagogy ConferenceCSU FresnoAugust 18, 2014Ed Nuhfer – Director of Faculty Development, Director of Educational Assessment and Professor of Geology (University of Wisconsin, University of Colorado, Idaho State University, California State University (retired) Phone
2 “High level teaching" is "…teachers teaching the students something, instructing them in how to produce something, and giving them instruction as to the processes of learning.”Hattie, J. (2009). Visible Learning: A Synthesis of over 800 Meta-Analyses Relating to Achievement. New York, New York: Routledge. P. 11.
3 CCER, BIAC, OECD/CERI Colloquium Metacurriculum for Metacognition14-15 October 2013InstrumentsKnowledge or SkillLearning-across-curriculum modulesStrategies and developing a learning philosophyReading ReflectionsReflection & MonitoringExam WrappersReflection, Monitoring & EvaluationKnowledge SurveysGoal-setting, Monitoring & Evaluation Developing self-assessment & self-efficacyLearning JournalsEvaluation & Goal-setting Developing self-assessment & self-efficacyMetadisciplinary Concept Inventories (Assessment)Reasoning, respect for diverse ways of knowing, overarching philosophy for becoming educated
4 Available Learning-Across-the-Curriculum Modules From CSU Faculty Developers
5 Used by permission of S. E. Petersen Used by permission of S. E. Petersen. Positron emission tomographic studies of the processing of single words.
7 “Exam Wrappers” What did I do well on and why? 95% for the exam plus 5% for submitting the following metacognitive reflection:What did I do well on and why?What did I do less well and why?When I encounter a similar challenge, what strategy will I use to perform better?
8 Reflective Learning Journals (1) Summarize your assumptions, beliefs, understanding that you had when you first encountered the topic assigned here, before you started to engage it during learning it in this courseAssessing what one thinks at the start of a task is a common theme in metacognition. A free writing exercise given at the introduction of a new topic is ideal for helping students capture their baseline knowledge and archive that for later use in a journal entry.
9 Reflective Learning Journals (2) Disclose new vocabulary that you acquired during your study of this topic. Include vocabulary that you may have acquired as part of your process in items 4-6 below.Building vocabulary increases reading comprehension and personal ability to access information.
10 Reflective Learning Journals (3) Discover and describe connections that you can make between the topic and several other class sessions, exercises, readings, homework. Note in SPECIFICS what you found from making these connections that informed or expanded your understanding of the topic. Be sure to note how this learning is relevant to one or more of the published learning outcomes for the course. Refer to the specific outcome(s).Metacognitive reflection uncovers connections that are otherwise difficult to access. Practice in seeking connections between lessons and larger ideas is immensely valuable.
11 Reflective Learning Journals (4) So as avoid depending on materials given to you in class, take action on your own behalf by looking to other resources. To provide evidence of this learning, describe IN SPECIFICS what you learned and from what source(s).Assigning students to go beyond what authority (instructors) offers them moves beginning students to higher-level stages of thinking. Metacognition trains independent thinking.
12 Reflective Learning Journals (5) “Close the loop” by comparing what you knew in #1 against what you know now.Seeing one's growth affirmed builds self-efficacy.
13 Journal template furnished as “blueline helpsheet”
14 Journal template furnished as “blueline helpsheet” Download it from
15 Knowledge surveys Metacognitive self-assessments If I think I can do this, how well can I do this?Can I look at the items and start to distinguish which emphasize knowledge, skills or reasoning?For construction, consult the tutorials at
17 Our challenge is to keep students in constant contact with their metacognition… KS ITEM – COURSE CONTENT: I can explain why it was necessary to first understand the principles of original horizontality, superposition, and crosscutting relationships before scientists could begin to derive the theory of plate tectonics.KS ITEM — METADISCPLINARY OUTCOME: I can employ examples to illustrate key differences between the ways of knowing of science and of technology.KS ITEM — STAGE IN DEVELOPMENT OF THINKING: My friend tells me: "Because everyone has a right to his or her opinion, we respect others by accepting all opinions as equally valid.” I can recognize the stage of intellectual development revealed by that statement.
18 Hattie (2009, p ) found present understanding of level of achievement as the most significant attribute of students for meeting their future goals.
19 Self-Efficacy“If I have the belief that I can do it, I shall surely acquire the capacity to do it, even if I may not have it at the beginning.” Mahatma Gandhi
20 KSs as an aid to teaching self-efficacy Self-efficacy—realistic belief in self regarding the proficiency that one can attain with instruction and support.Alfred Bandura established strong self-efficacy as one of the most important predictors of student success (www.des.emory.edu/mfp/self-efficacy.htm)PRE-COURSE: “Good heavens! Will we be able to learn ALL this?"POST COURSE: "I really did learn that much.”
21 Correlations between performance and several metacognitive self-assessments (n = 1011) First Impression Global Self-assessmentKnowledge Survey item-by-item Self-AssessmentPost-Knowledge Survey Overall Self- AssessmentPost-SLCI Overall Self-assessment (*n=590)SLCI Actual Scorer = 0.29r = 0.58r = 0.45r = 0.62*Average 72 %Average 75%Average 79%Average 76%Average* 76%
22 Metadisciplinary Ways of Knowing You have a handout with outcomes for six metadisciplinesIf not, grab it from
23 Example of the reasoning component of “Science literacy” Insert your own metadiscipline’s outcomes in place of “science” as you consider what follows.If a citizen understands science’s way of knowing, how can we recognize this? How can students recognize when they are “getting it?”
24 Concepts for Citizen Literacy in the Metadiscipline of Science 1. Science explains physical phenomena based upon testable information about the physical world. 2. In modern life, science literacy is important to both personal and collective decisions that involve science content and reasoning. 3. Doubt plays necessary roles in advancing science. 4. Scientists use evidence-based reasoning to select which among several competing working hypotheses best explains a physical phenomenon. 5. A theory in science is a unifying explanation for observations that result from testing several hypotheses. 6. Peer review generally leads to better understanding of physical phenomena than can the unquestioned conclusions of involved investigators. 7. Science can test certain kinds of hypotheses through controlled experiments. 8. All science rests on fundamental assumptions about the physical world. 9. Science differs from technology. 10. Scientific knowledge is discovered, and some discoveries require an important history. 11. Science employs modeling as a method for understanding the physical world. 12. Scientific knowledge imparts power that must be used ethically.
25 Concepts restated as 12 Outcomes for Science Literacy Students will be able to… 1. Define the domain of science and determine whether a statement constitutes a hypothesis that can be resolved within that domain. 2. Describe through example how science literacy is important in everyday life to an educated person. 3. Explain why the attribute of doubt has value in science. 4. Explain how scientists select which among several competing working hypotheses best explains a physical phenomenon. 5. Explain how "theory" as used and understood in science differs from "theory "as commonly used and understood by the general public. 6. Explain why peer review generally improves our quality of knowing within science. 7. Explain how science employs the method of reproducible experiments to understand and explain the physical world. 8. Articulate how science’s way of knowing rests on some assumptions. 9. Distinguish between science and technology by examples of how these are different frameworks of reasoning. 10. Cite a single major theory from one of the science disciplines and explain its historical development. 11. Explain and provide an example of how modeling is used in science. 12. Explain why ethical decision-making becomes increasingly important to a society as it becomes increasingly advanced in science.
27 The Instrument For each outcome In addition… Construct several concept inventory items.Use established methods for drafting items that have been developed in other concept inventories.In addition…Test reasoning, not factual knowledge.Administer the inventory under the conditions in which a citizen will use common information.
28 …initial instrument constructed 2008-2010 through the collegial efforts of Edward Nuhfer, Faculty Development & Geology, Channel IslandsJerry Clifford, Physics, Channel IslandsChristopher Cogan, Environmental Sciences & Resource Management, Channel IslandsAnya Goodman, Biochemistry, San Luis ObispoCarl Kloock, Biology, BakersfieldBeth Stoeckly, Physics, Channel IslandsChristopher Wheeler, Geology, Channel IslandsGregory Wood, Physics, Channel IslandsNatalie Zayas, Science Education & Environmental Sciences, Monterey BayNote: 9 people, 5 disciplines, and 4 CSU campuses
29 Science Literacy Concept Inventory Incorporates 25 validated items that map to the twelve conceptsReliability of .85Tested on over 16,000 students in about 30 institutions
30 Outcome. Student can define the domain of science and determine whether a statement constitutes a hypothesis that can be resolved within that domain.Concept Some MisconceptionsScience explains physical phenomena based upon testable information about the physical world.Science is on a mission to refute religion; scientists study the paranormal; untestable statements are like scientific hypotheses.
31 Which of the following statements presents a hypothesis that science can now easily resolve? A. Warts can be cured by holding quartz crystals on them daily for a week.B. A classmate sitting in the room can see the auras of other students.C. Radio City Music Hall in New York is haunted by several spirits.D. People with chronic illnesses have them as punishment for past misdeeds.Correct answer is: A This is testable.Answer B: False. Not testable.Answer C: False. Not testable.Answer D: False. Not testable.
32 Which of the following statements presents a hypothesis that science can now easily resolve? A. Warts can be cured by holding quartz crystals on them daily for a week.B. A classmate sitting in the room can see the auras of other students.C. Radio City Music Hall in New York is haunted by several spirits.D. People with chronic illnesses have them as punishment for past misdeeds.Correct answer is: AThis is testable.Answer B: False. Not testable.Answer C: False. Not testable.Answer D: False. Not testable.
33 What did we learn that made this so interesting? Starting with…Do experts (professors) outscore novices (students)?
34 YES! They do! Also, students on average do come to us with some science literacy: zero literacy = about 25% (random guessing).