1. CMU 2009 http://www.chemcollective.org 1http://www.chemcollective.org What is conceptual learning in chemistry and why should we promote it? David Yaron +, Michael Karabinos +, Jodi Davenport *, Jordi Cuadros + Department of Chemistry + and Psychology *, Carnegie Mellon University Gaea Leinhardt, Jim Greeno, Karen Evans Learning Research and Development Center, University of Pittsburgh Laura Bartolo +, John Portman * Department of Information Science + and Biology *, Kent State University W. Craig Carter, and Donald Sadoway Department of Materials Science, MIT

2. CMU 2009 http://www.chemcollective.org 2http://www.chemcollective.org NSDL ChemDLMatDL Digital Library and Projects Overview Chem Ed DL Portal for all of chemistry Collaboration between ACS and J. Chem. Ed. www.chemeddl.org Materials for Introductory chemistry Virtual labs Scenario based learning Tutorials Can a digital library provide a community space for promoting conceptual learning in chemistry? www.chemcollective.org ChemCollective Open Learning Initiative OLI Pittsburgh Science of Learning Center PSLC OLI Full online courses www.cmu.edu/oli PSLC Fundamental studies to advance the theory of learning www.learnlab.org

3. CMU 2009 http://www.chemcollective.org 3http://www.chemcollective.org ChemCollective as a Digital Library ChemCollective Learning Technologist Educators Learning Scientists Configurable virtual lab Tools for creating explanations and assessments Tools for data collection Activity and curriculum creation Feedback on classroom use Domain analysis Learning assessment

4. CMU 2009 http://www.chemcollective.org 4http://www.chemcollective.org What is conceptual learning? Physics’ Force Concept Inventory –Mathematical problem solving does not necessarily lead to ability to answer qualitative questions –Students learn what they practice. Physics’ answer to “What is conceptual learning?” –Non-conceptual instruction students struggle with hard problems –Conceptual instruction Couple mathematical problem solving with qualitative questions

5. CMU 2009 http://www.chemcollective.org 5http://www.chemcollective.org Conceptual learning Being systematic about the goals of instruction and aligning the instruction to these goals Four projects related to conceptual learning –Virtual lab –What is needed for scientific literacy? –Teaching chemical equilibrium –Molecular science across disciplines

6. CMU 2009 http://www.chemcollective.org 6http://www.chemcollective.org Virtual laboratory Goal : Connecting mathematics to authentic chemistry Approach : Problem solving that involves experimental design and data analysis Virtual Lab : Ability to “see” inside a solution removes one level of indirection in chemical problem solving

7. CMU 2009 http://www.chemcollective.org 7http://www.chemcollective.org Classroom uses In a computer lab As take-home work Pre- and post-labs Lab make-ups Supplement to in-class demonstrations Current topic list –Molarity - Stoichiometry –Quantitative analysis - Chemical equilibrium –Solubility - Thermochemistry –Acids and bases Problem types –Predict and check –Virtual experiment Labs designed to be similar to common physical labs Puzzle problems (open-ended and inquiry based experiments)

8. CMU 2009 http://www.chemcollective.org 8http://www.chemcollective.org Virtual lab use Replacing textbook-style problems with experimental design and data analysis problems Breaks shallow “means-ends” problem solving strategy –4 sections of 30-45 students working alone; 4-5 instructors/observers –The Virtual Lab format requires students to go beyond matching words to equations Typical textbook problem “When 10ml of 1M A was mixed with 10ml of 1M B, the temperature went up by 10 degrees. What is the heat of the reaction between A and B?” Virtual Lab problem “Construct an experiment to measure the heat of reaction between A and B?”

9. CMU 2009 http://www.chemcollective.org 9http://www.chemcollective.org Virtual lab use “The virtual lab contains 1M solutions of A, B, C, and D. Construct experiments to determine the reaction between these reagents” 100 mL 1 M A + 100 mL 1 M C  0.25 M A + 0.25 M B + 0.25 M D 50 % of students put A as reactant and product A + C  A + B + D Actual reaction A + 2 C  B + D

10. CMU 2009 http://www.chemcollective.org 10http://www.chemcollective.org Virtual lab use “The virtual lab contains 1M solutions of A, B, C, and D. Construct experiments to determine the reaction between these reagents” 100 mL 1 M A + 100 mL 1 M C  0.25 M A + 0.25 M B + 0.25 M D Find stoichiometry through titration –Slowly add 1M A to 100 ml of C until all the C is consumed –50 mL of A leads to 1:2 ratio of A to C in the reaction A + 2 C 

11. CMU 2009 http://www.chemcollective.org 11http://www.chemcollective.org Virtual lab use “The virtual lab contains 1M solutions of A, B, C, and D. Construct experiments to determine the reaction between these reagents” Single step solution –Mix equal volumes of 1M A, 1M B, 1M C, and 1M A B C D Initial 0.25 0.25 0.25 0.25 Change -0.125 +0.125 -0.25 +0.125 Final 0.125 0.375 0 0.375 A + 2 C  B + D

12. CMU 2009 http://www.chemcollective.org 12http://www.chemcollective.org Assessment within a large lecture course Study at Carnegie Mellon –Second semester intro course, 150 students Information used –Pretest –9 homework activities (virtual labs with templated feedback) –3 hour exams –2 pop exams (practice exam given 5 days before hour exam) –Final exam

13. CMU 2009 http://www.chemcollective.org 13http://www.chemcollective.org Correlations Pre Test Home-workPop ExamExamFinal Pre test 1.00 Home work 0.031.00 Pop Exam 0.50 0.151.00 Exam 0.320.430.51 1.00 Final 0.23 0.580.370.59 1.00

14. CMU 2009 http://www.chemcollective.org 14http://www.chemcollective.org Regression and structural equation model Linear regression accounts for 48% of the variance in the final grades Influence of homework accounts for half of the model predictions Structural equation model supports conclusions drawn from the regression

15. CMU 2009 http://www.chemcollective.org 15http://www.chemcollective.org Assessment within OLI online stoichiometry module Study design –Treatment (20): Online course including a scenario, tutors and virtual lab homework –Control (20): Paper and pencil, worked examples and practice –Assessment was traditional problem solving of quantitative stoichiometry problems, and some qualitative questions Text-only Mean=65 Multimedia Mean=77 Virtual Lab use was positively correlated with better performance.

16. CMU 2009 http://www.chemcollective.org 16http://www.chemcollective.org Conceptual learning in chemistry: What is it? Virtual laboratory –Connecting mathematics to authentic chemistry What is needed for scientific literacy? Teaching chemical equilibrium Molecular science across disciplines

17. CMU 2009 http://www.chemcollective.org 17http://www.chemcollective.org Conceptual learning in chemistry: What is it? Virtual laboratory –Connecting mathematics to authentic chemistry What is needed for scientific literacy? Teaching chemical equilibrium Molecular science across disciplines

18. CMU 2009 http://www.chemcollective.org 18http://www.chemcollective.org Traditional high school course structure CA state standards –Standard 1 Atomic and Molecular Structure –Standard 2 Chemical Bonds –Standard 3 Conservation of Matter and Stoichiometry –Standard 4 Gases and Their Properties –Standard 5 Acids and Bases –Standard 6 Solutions –Standard 7 Chemical Thermodynamics –Standard 8 Reaction Rates –Standard 9 Chemical Equilibrium –Standard 10 Organic Chemistry and Biochemistry –Standard 11 Nuclear Processes Current chemistry AP exam guides are similarly structured around chemistry topic list

19. CMU 2009 http://www.chemcollective.org 19http://www.chemcollective.org Domain analysis for chemical literacy Evidence of the domain as practiced –Nobel prizes for past 50 years (1952-2002) –NY Times Science Times for 2002 (54 reports) –Scientific American News Bites for 2002 (32 reports) Evidence of the domain as taught –CA state content standards –Best selling textbooks

20. CMU 2009 http://www.chemcollective.org 20http://www.chemcollective.org Domain map EXPLAINANALYZE SYNTHESIZE Hypothesis Generation Hypothesis Testing Goal (What do you want to know?) Process (How to determine What you have) Functional Motifs Structural Motifs Assembly Motifs TOOLBOX Representational Systems Quantification Systems

21. CMU 2009 http://www.chemcollective.org 21http://www.chemcollective.org Full domain map Evans, Karabinos, Leinhardt & Yaron, J. Chem. Ed. (2006)

22. CMU 2009 http://www.chemcollective.org 22http://www.chemcollective.org Results of text analysis Synthesize Analyze Explain Toolbox Chem in TextbooksChem in the World

23. CMU 2009 http://www.chemcollective.org 23http://www.chemcollective.org Scenarios: Examples Mixed reception (molecular weight, stoichiometry) Cyanine dyes binding to DNA (equilibrium, Beer’s law) Meals read-to-eat (thermochemistry) Mission to mars (redox, thermochemistry) Arsenic poisoning of wells in Bangladesh (stoichiometry, titration, analytical spectroscopy) Ozone destruction (kinetics)

24. CMU 2009 http://www.chemcollective.org 24http://www.chemcollective.org Conceptual learning in chemistry: What is it? Virtual laboratory –Connecting mathematics to authentic chemistry What is needed for scientific literacy? –Replacing skills focus with knowledge of what chemists do Teaching chemical equilibrium Molecular science across disciplines

25. CMU 2009 http://www.chemcollective.org 25http://www.chemcollective.org Conceptual learning in chemistry: What is it? Virtual laboratory –Connecting mathematics to authentic chemistry What is needed for scientific literacy? –Replacing skills focus with knowledge of what chemists do Teaching chemical equilibrium Molecular science across disciplines

26. CMU 2009 http://www.chemcollective.org 26http://www.chemcollective.org Chemical equilibrium Goal: Discovery why this topic is so difficult to learn, and try to fix it Approach: –Domain analysis –Student talk alouds on traditional problems –Discovered “implicit knowledge” that could be made explicit in the instruction

27. CMU 2009 http://www.chemcollective.org 27http://www.chemcollective.org Chemical equilibrium Goal: Discovery why this topic is so difficult to learn, and try to fix it Approach: –Domain analysis 1. Utility of the knowledge 2. Detailed structure of the knowledge 3. Psychological aspects of the knowledge –Student talk alouds on traditional problems –Discovered “implicit knowledge” that could be made explicit in the instruction

28. CMU 2009 http://www.chemcollective.org 28http://www.chemcollective.org Chemical equilibrium / Acid-base chemistry 1) Utility of the knowledge –How is this knowledge used in organic chemistry and molecular biology 1)Compare pH to pK a to determine ionization state 2)Buffers used to control pH (qualitative not quantitative) 3)Titration as an analytical technique –Current instruction 1: Almost a footnote (in the pH indicators section) 2-3: Coverage may not be sufficiently qualitative

29. CMU 2009 http://www.chemcollective.org 29http://www.chemcollective.org Chemical equilibrium / Acid-base chemistry 2) Detailed structure of the knowledge –Need to be flexible with “progress of reaction” –General strategy (majority/minority species strategy) 3) Psychological aspects of the knowledge –LeChatlier (especially with addition/removal of a species) is most retained concept –Broad confusion regarding “progress of reaction” Q (current state) vs. K (state towards which system tends) Meaning of “initial” vs. “equilibrium” state

30. CMU 2009 http://www.chemcollective.org 30http://www.chemcollective.org What can we build on? LeChatlier’s principle plays role of “prior knowledge” Human respiration is scenario to which to attach “initial” vs. “equilibrium” state –Blood entering lungs and muscles experiences a new initial state –Blood leaving lungs and muscles has reached a new equilibrium state

31. CMU 2009 http://www.chemcollective.org 31http://www.chemcollective.org Progress of Reaction Based on expert/novice protocol study 2NO 2 N 2 O 4

32. CMU 2009 http://www.chemcollective.org 32http://www.chemcollective.org Majority / Minority Problem Solving Strategy Old instruction –“Small x approximation” –Highly mathematical New instruction –Majority/minority species strategy –Couples the problem solving steps to qualitative reasoning

33. CMU 2009 http://www.chemcollective.org 33http://www.chemcollective.org Old Instruction Small x approximation

34. CMU 2009 http://www.chemcollective.org 34http://www.chemcollective.org New Instruction Step 1: Push strong reactions to completion (identify majority species) Step 2: Use K=Q to find [ ]’s of minority species

35. CMU 2009 http://www.chemcollective.org 35http://www.chemcollective.org Results Coordination of core concepts with problem solving procedures led to large improvement in problem solving performance.

36. CMU 2009 http://www.chemcollective.org 36http://www.chemcollective.org Majority vs. minority species A general strategy –Find all strong reactions (K>>1) Acid base: OH - + H + ; HA + OH - and A - + H + Solubility: M + + X - and M + + L –Thought experiment: Assume large K’s are infinite and do a limiting reagent calculation All species that do not go to zero, are majority species and you now know their concentration –Determine minority species, via equilibrium expressions (K=Q)

37. CMU 2009 http://www.chemcollective.org 37http://www.chemcollective.org Conceptual learning in chemistry: What is it? Virtual laboratory –Connecting mathematics to authentic chemistry What is needed for scientific literacy? –Replacing skills focus with knowledge of what chemists do Teaching chemical equilibrium –Connecting problem solving procedures to chemical concepts/mental models Molecular science across disciplines

38. CMU 2009 http://www.chemcollective.org 38http://www.chemcollective.org Conceptual learning in chemistry: What is it? Virtual laboratory –Connecting mathematics to authentic chemistry What is needed for scientific literacy? –Replacing skills focus with knowledge of what chemists do Teaching chemical equilibrium –Connecting problem solving procedures to chemical concepts/mental models Molecular science across disciplines

39. CMU 2009 http://www.chemcollective.org 39http://www.chemcollective.org Conceptual frameworks that cross disciplines Scope is molecular science –How molecular structure and motion lead to emergent macroscopic properties –The synthesis/engineering of structures with desirable properties Build materials for discipline-specific courses, but that use a common core set of materials to show interdisciplinary connections Experts from multiple domains (chemistry, materials science, biophysics) met to identify concepts/frameworks that are –Central to their domain –Have strong leverage –Are difficult to teach/learn

40. CMU 2009 http://www.chemcollective.org 40http://www.chemcollective.org Outcome of the Design Process Reaction paths and energy landscapes Used to describe, for example, –Organic chemistry reactions –Diffusion on surfaces –Protein folding/unfolding

41. CMU 2009 http://www.chemcollective.org 41http://www.chemcollective.org Development process Analyze content with experts, novices and psychologists Sequential focus on aspects of the diagram –What is Q? –What is temperature? –Energy vs. free energy

42. CMU 2009 http://www.chemcollective.org 42http://www.chemcollective.org What is the reaction coordinate Q?

43. CMU 2009 http://www.chemcollective.org 43http://www.chemcollective.org Motion connected to a heat bath

44. CMU 2009 http://www.chemcollective.org 44http://www.chemcollective.org Coordination

45. CMU 2009 http://www.chemcollective.org 45http://www.chemcollective.org Entropy: Energy vs. free energy

46. CMU 2009 http://www.chemcollective.org 46http://www.chemcollective.org Other conceptual frameworks of molecular science Reaction paths and energy landscapes Molecular forces –e.g. Structure formation at different temperatures Economies of exchange –Heat, proton (acid/base) and electron (redox) exchange How natural and designed systems promote one chemical process over another –e.g. Kinetic vs. thermodynamic control

47. CMU 2009 http://www.chemcollective.org 47http://www.chemcollective.org Conceptual learning in chemistry: What is it? Virtual laboratory –Connecting mathematics to authentic chemistry What is needed for scientific literacy? –Replacing skills focus with knowledge of what chemists do Teaching chemical equilibrium –Connecting problem solving procedures to chemical concepts/mental model Molecular science across disciplines –Conceptual frameworks that have broad utility

48. CMU 2009 http://www.chemcollective.org 48http://www.chemcollective.org Digital library assessment Web logs Monitoring the pathway from seeing to contributing –Target audience: 9000 college and 100,000 high school instructors – See the collection: 7000 – Use the collection: 200 – Contribute to the collection: 62 11 have contributed activities (56 activities) 11 have contributed translations (11 languages, 70 activities) 40 have given feedback, 13 volunteered for learning studies

49. CMU 2009 http://www.chemcollective.org 49http://www.chemcollective.org Closing comments Can digital libraries serve as community spaces for promoting conceptual teaching and learning of chemistry? –Virtual lab does get reused and repurposed Homework tool Many instructors find the approach compelling –Chemical equilibrium and cross-disciplinary materials Too soon to tell –Shifting high school chemistry from skills to literacy No progress yet

50. CMU 2009 http://www.chemcollective.org 50http://www.chemcollective.org Carnegie Mellon Michael Karabinos Jodi Davenport Donovan Lange D. Jeff Milton Jordi Cuadros Rea Freeland Emma Rehm William McCue David H. Dennis Tim Palucka Jef Guarent Amani Ahmed Giancarlo Dozzi Katie Chang Erin Fried Jason Chalecki Greg Hamlin Brendt Thomas Stephen Ulrich Jason McKesson Aaron Rockoff Jon Sung Jean Vettel Rohith Ashok Joshua Horan LRDC, University of Pittsburgh Gaea Leinhardt Jim Greeno Karen Evans Baohui Zhang Thanks To Funding NSF: CCLI, NSDL, SLC William and Flora Hewlett Foundation Howard Hughes Medical Institute Dreyfus Foundation