1 Straightforward Backward Course Design Karl A. Smith Civil Engineering University of Minnesota Science and Engineering Education Scholars Program B Seventh Annual Conference Penn State Minnesota July 2004

To teach is to engage students in learning; thus teaching consists of getting students involved in the active construction of knowledge...The aim of teaching is not only to transmit information, but also to transform students from passive recipients of other people's knowledge into active constructors of their own and others' knowledge...Teaching is fundamentally about creating the pedagogical, social, and ethical conditions under which students agree to take charge of their own learning, individually and collectively Education for judgment: The artistry of discussion leadership. Edited by C. Roland Christensen, David A. Garvin, and Ann Sweet. Cambridge, MA: Harvard Business School, 1991.

3 Formulate-Share-Listen-Create (Think-Pair-Share) Individually read the quote “To teach is to engage students in learning...” Underline/Highlight words and/or phrase that stand out for you Turn to the person next to you, introduce yourself Share words and/or phrases that stood out and discuss

4 It could well be that faculty members of the twenty-first century college or university will find it necessary to set aside their roles as teachers and instead become designers of learning experiences, processes, and environments James Duderstadt, 1999

5 Knowledge Probe Individually complete the knowledge probe Example from MOT 8221 What would you like to know about the students in your courses?

6

7 PMQ1 KMQ2 PMIQ3 EngSysQ4 IE/ORQ5 Mod/SimQ6 MgmtSciQ7 6 SigmaQ8

8 SpreadQ1 PMQ2 StatQ3 Mod/SimQ4 DBQ5 ProgQ6

9 Knowledge Probe Individually complete the knowledge probe Example from MOT 8221 What would you like to know about the students in your courses? Talk with a partner

10 Session Goals This session provides an opportunity for participants to: 1.Explore the pedagogical shift from providing instruction to enhancing student learning. 2.Identify desired learning outcomes for students. 3.Find out about and experience teaching methods that create active learning opportunities for students in a lecture setting. 4.Discuss ways to help students think critically about the information presented in lectures and prepare them to apply it in real-world settings. 5.Gain a conceptual understanding of cooperative learning and find out how to operationalize and use both informal and formal cooperative learning groups effectively. 6.Determine acceptable evidence of students’ learning. 7.Build cooperative teaching and learning skills while building a professional network of colleagues dedicated to enhancing student learning.

11 Your Session Goals Participants’ Goals for the Workshop: Choose three of the listed goals that are most important for you and your colleagues?

12 Book Ends on a Class Session See Cooperative Learning Handout for details

Book Ends on a Class Session 1.Advance Organizer 2.Formulate-Share-Listen-Create (Turn- to-your-neighbor) -- repeated every minutes 3.Session Summary (Minute Paper) 1.What was the most useful or meaningful thing you learned during this session? 2.What question(s) remain uppermost in your mind as we end this session? 3.What was the “muddiest” point in this session?

14 Advance Organizer AThe most important single factor influencing learning is what the learner already knows. Ascertain this and teach him David Ausubel - Educational psychology: A cognitive approach, 1968.

15 Formulate-Share-Listen-Create (Think-Pair-Share) Informal Cooperative Learning Group Introductory Pair Discussion of a FOCUS QUESTION 1.Formulate your response to the question individually 2.Share your answer with a partner 3.Listen carefully to your partner's answer 4.Work together to Create a new answer through discussion

16 Quick Thinks Reorder the steps Paraphrase the idea Correct the error Support a statement Select the response Johnston, S. & Cooper,J Quick thinks: Active- thinking in lecture classes and televised instruction. Cooperative learning and college teaching, 8(1), 2-7.

17 Minute Paper What was the most useful or meaningful thing you learned during this session? What question(s) remain uppermost in your mind as we end this session? What was the “muddiest” point in this session? Give an example or application Explain in your own words... Angelo, T.A. & Cross, K.P Classroom assessment techniques: A handbook for college teachers. San Francisco: Jossey Bass.

18 Informal CL (Book Ends on a Class Session) with Concept Tests Physics Peer Instruction Eric Mazur - Harvard B Peer Instruction – Richard Hake – Chemistry Chemistry ConcepTests - UW Madison B Video: Making Lectures Interactive with ConcepTests ModularChem Consortium B STEMTEC Video: How Change Happens: Breaking the ATeach as You Were Cycle B Films for the Humanities & Sciences B Thinking Together video: Derek Bok Center B

Richard Hake (Interactive engagement vs traditional methods) Traditional (lecture) Interactive (active/cooperative) = Concept Inventory Gain/Total

20

Lila M. Smith

Cooperative Learning Research Support Johnson, D.W., Johnson, R.T., & Smith, K.A Cooperative learning returns to college: What evidence is there that it works? Change, 30 (4), Over 300 Experimental Studies First study conducted in 1924 High Generalizability Multiple Outcomes Outcomes 1. Achievement and retention 2. Critical thinking and higher-level reasoning 3. Differentiated views of others 4. Accurate understanding of others' perspectives 5. Liking for classmates and teacher 6.Liking for subject areas 7. Teamwork skills

Small-Group Learning: Meta-analysis Springer, L., Stanne, M. E., & Donovan, S Effects of small-group learning on undergraduates in science, mathematics, engineering, and technology: A meta- analysis. Review of Educational Research, 69(1), Small-group (predominantly cooperative) learning in postsecondary science, mathematics, engineering, and technology (SMET). 383 reports from 1980 or later, 39 of which met the rigorous inclusion criteria for meta-analysis. The main effect of small-group learning on achievement, persistence, and attitudes among undergraduates in SMET was significant and positive. Mean effect sizes for achievement, persistence, and attitudes were 0.51, 0.46, and 0.55, respectively.

Strategies for Energizing Large Classes: From Small Groups to Learning Communities: Jean MacGregor, James Cooper, Karl Smith, Pamela Robinson New Directions for Teaching and Learning, No. 81, Jossey- Bass

26 Session Summary (MINUTE PAPER) PART A DIRECTIONS: Read the following questions, and write a brief answer to each one. What is most important point conveyed during this session? What is one new teaching activity you are willing to try? What is 1 question you have about the session? PART B DIRECTIONS: Read each statement in the scale below. Circle the degree to which you either agree or disagree with it. SD=Strongly Disagree D=Disagree N= Neutral A=AgreeSA=Strongly Agree 1. I was comfortable with the pace of the session. SD D N A SA 2. I found the content to be relevant. SD D N A SA 3. I found the activities to be useful.SD D N A SA

27 Effective Course Design Students Goals and Objectives Assessment EC 2000 Bloom’s Taxonomy Course-specific goals & objectives Cooperative learning Lectures Labs Other experiences Classroom assessment techniques Tests Instruction Other measures Technology (Felder & Brent, 1999)

28 Straightforward Backward Design Stage 1. Identify Desired Results/Goals Stage 2. Determine Acceptable Evidence/ Assessment Stage 3. Plan Learning Activities and Instruction

29 A Self-Directed Guide to Designing Courses for Significant Learning L. Dee Fink Creating significant learning experiences. Jossey-Bass.

30 Taxonomies Bloom’s taxonomy of educational objectives: Cognitive Domain (Bloom & Krathwohl, 1956) A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives (Anderson & Krathwohl, 2001). Facets of understanding (Wiggins & McTighe, 1998) Creating significant learning experiences ( L. Dee Fink. 2003)

31 The Six Major Levels of Bloom's Taxonomy of the Cognitive Domain (with representative behaviors and sample objectives) Knowledge. Remembering information Define, identify, label, state, list, match Identify the standard peripheral components of a computer Write the equation for the Ideal Gas Law Comprehension. Explaining the meaning of information Describe, generalize, paraphrase, summarize, estimate In one sentence explain the main idea of a written passage Describe in prose what is shown in graph form Application. Using abstractions in concrete situations Determine, chart, implement, prepare, solve, use, develop Using principles of operant conditioning, train a rate to press a bar Derive a kinetic model from experimental data Analysis. Breaking down a whole into component parts Points out, differentiate, distinguish, discriminate, compare Identify supporting evidence to support the interpretation of a literary passage Analyze an oscillator circuit and determine the frequency of oscillation Synthesis. Putting parts together to form a new and integrated whole Create, design, plan, organize, generate, write Write a logically organized essay in favor of euthanasia Develop an individualized nutrition program for a diabetic patient Evaluation. Making judgments about the merits of ideas, materials, or phenomena Appraise, critique, judge, weigh, evaluate, select Assess the appropriateness of an author's conclusions based on the evidence given Select the best proposal for a proposed water treatment plant

32 Facets of Understanding Wiggins & McTighe, 1998, page 44 When we truly understand,we Can explain Can interpret Can apply Have perspective Can empathize Have self-knowledge

33 A Self-Directed Guide to Designing Courses for Significant Learning L. Dee Fink Creating significant learning experiences. Jossey-Bass.

34 Understanding Stage 1. Identify Desired Results Focus Question: What does it mean to “understand”? Stage 2. Determine Acceptable Evidence Focus Questions: “How will we know if students have achieved the desired results and met the standards? What will we accept as evidence of student understanding and proficiency (Wiggins & McTighe)

35 Understanding Misunderstanding A Private Universe – 21 minute video available from Also see Minds of our own (Annenberg/CPB Math and Science Collection – 1.Can we believe our eyes? 2.Lessons from thin air 3.Under construction

36 Backward Design Stage 1. Identify Desired Results Filter 1. To what extent does the idea, topic, or process represent a big idea or having enduring value beyond the classroom? Filter 2. To what extent does the idea, topic, or process reside at the heart of the discipline? Filter 3. To what extent does the idea, topic, or process require uncoverage? Filter 4. To what extent does the idea, topic, or process offer potential for engaging students?

37 Worksheet 1 Worksheet for Designing a Class Ways of Assessing Actual Teaching-Learning Helpful Resources: Learning Goals for Class: This Kind of Learning: Activities: (e.g., people, things) List 3-5 goals for a class you teach -- At the end of this class session my students will...

38 Backward Design Stage 2. Determine Acceptable Evidence Types of Assessment Quiz and Test Items: Simple, content-focused test items Academic Prompts: Open-ended questions or problems that require the student to think critically Performance Tasks or Projects: Complex challenges that mirror the issues or problems faced by graduates, they are authentic

39 Worksheet 1 Worksheet for Designing a Class Ways of Assessing Actual Teaching-Learning Helpful Resources: Learning Goals for Class: This Kind of Learning: Activities: (e.g., people, things) List 3-5 goals for a class you teach -- At the end of this class session my students will... List assessment Procedure for one goal

40 Backward Design Stage 3. Plan Learning Activities & Instruction What enabling knowledge (facts, concepts, and principles) and skills (procedures) will students need to perform effectively and achieve desired results? What activities will equip students with the needed knowledge and skills? What will need to be taught and coached, and how should it be taught, in light of performance goals? What materials and resources are best suited to accomplish these goals? Is the overall design coherent and effective?

41 Active Learning: Cooperation in the College Classroom Informal Cooperative Learning Groups Formal Cooperative Learning Groups Cooperative Base Groups

Cooperative Learning is instruction that involves people working in teams to accomplish a common goal, under conditions that involve both positive interdependence (all members must cooperate to complete the task) and individual and group accountability (each member is accountable for the complete final outcome). Key Concepts Positive Interdependence Individual and Group Accountability Face-to-Face Promotive Interaction Teamwork Skills Group Processing

43

Informal Cooperative Learning Groups Can be used at any time Can be short term and ad hoc May be used to break up a long lecture Provides an opportunity for students to process material they have been listening to (Cognitive Rehearsal) Are especially effective in large lectures Include "book ends" procedure Are not as effective as Formal Cooperative Learning or Cooperative Base Groups

45

46

47 Professor's Role in Formal Cooperative Learning 1.Specifying Objectives 2.Making Decisions 3.Explaining Task, Positive Interdependence, and Individual Accountability 4.Monitoring and Intervening to Teach Skills 5.Evaluating Students' Achievement and Group Effectiveness

48

49

50 Course/Session Design - Cooperative Learning Format TASK: Complete the course design project. INDIVIDUAL: Everyone contributes. COOPERATIVE: One plan from the group, strive for agreement, make sure everyone is able to explain or demonstrate the learning activity. EXPECTED CRITERIA FOR SUCCESS: Everyone must be able to explain. EVALUATION: Does the learning strategy fit the selected goal? INDIVIDUAL ACCOUNTABILITY: One member from your group may be randomly chosen to explain or demonstrate the activity. EXPECTED BEHAVIORS: Active participating, checking, encouraging, and elaborating by all members. INTERGROUP COOPERATION: Each group will describe or demonstrate their activity to one other group.

51 Team Member Roles Task Recorder Checker – check to make sure each member understands and can explain Timekeeper

52 Worksheet 1 Worksheet for Designing a Class Ways of Assessing Actual Teaching-Learning Helpful Resources: Learning Goals for Class: This Kind of Learning: Activities: (e.g., people, things) List 3-5 goals for a class you teach -- At the end of this class session my students will... List assessment Procedure for one goal Plan Instruction

53 Resources Workshop Handouts – Resources University of Minnesota - Center for Teaching and Learning Services -- Richard Felder -- public/RMF.html Contact Information –Kathleen O’Donovan – –Karl Smith – –Connie Tzenis –

54