Presentation is loading. Please wait.

Presentation is loading. Please wait.

What If… Peggy Maki Education Consultant Specializing in Assessing Student Learning Presented at AAC&Us GE and Assessment Conference, Boston, March 1,

Similar presentations


Presentation on theme: "What If… Peggy Maki Education Consultant Specializing in Assessing Student Learning Presented at AAC&Us GE and Assessment Conference, Boston, March 1,"— Presentation transcript:

1 What If… Peggy Maki Education Consultant Specializing in Assessing Student Learning Presented at AAC&Us GE and Assessment Conference, Boston, March 1,

2 What if….. You became and were recognized as an Expert in Misunderstanding, using your expertise as the basis of systemically collaborating with colleagues to innovate curricular and co-curricular design, pedagogies, assignments, and educational practices to improve or advance All students enduring GE learning? 2

3 You specialized in learning about ways in which students…… Misunderstand Misinterpret Miscalculate Take unsuccessful approaches to solving a problem undertaking a task or set of tasks 3

4 Hold onto incorrect myths, beliefs, misconceptions, or knowledge that, if not addressed early in students journey, account for immediate difficulties students encounter or longer term difficulties as they continue their studies. 4

5 Have difficulties in moving from knowledge to understanding to transfer and application (depth of initial learning makes a difference how well do students acquire initial learning?) Land, Meyer, Smith,

6 You knew when or who else asked your students to draw on, apply, or reuse what you expected them to learn? You knew about the challenges or obstacles or trouble spots your students faced the next time they were asked to draw upon, apply, reuse, or integrate what you expected them to know? 6

7 You knew where and how well students traveled with what you taught them or positioned them to learn in your GE classes? You knew no one asked your students to use that learning after your course. 7

8 Student A: I dont really like history. There is too much to try to remember. And it is all about olden times-- with a lot of dates and different wars and people doing things we dont do any more. I am finished with that required course anyway. (inert) Student B: We learned how to tell the difference between facts and how different people filter and interpret the facts depending on their own interests. We also learned to examine texts– to point out and discuss what was left out of the different texts we read. I find that I do that now in my other courses. (activated) 8

9 What if your institutions valued you for Identifying the range of chronological challenges or barriers your students encounter and then Innovating proven practices that chronologically address challenges, barriers or trouble spots students face along the trajectory of their education so that increasingly more students succeed at higher levels of achievement? 9

10 Learning more about what you do not yet know, as well as for what you do know Collaboratively designing methods of inquiry into students learning and meaning-making processes (inquiry groups, learning circles, learning communities) 10

11 Why Become An Expert in Misunderstanding? 11

12 12

13 What We Know About Learners 30% 13

14 14 Learners create meaning: egocentricity, sociocentricity, narrow- mindedness, routinized habits

15 People learn differently and may hold onto folk or naive knowledge, incorrect concepts, misunderstandings, false information Deep learning (ELOs) occurs over timetransference 15

16 Threshold Concepts: pathways central to the mastery of a subject or discipline that change the way students view a subject or discipline, prompting students to bring together various aspects of a subject that they heretofore did not view as related (Land, Meyer, Smith, 2010). 16

17 Learning Progressions: knowledge- based, web-like interrelated actions or behaviors or ways of thinking, transitioning, self-monitoring. May not be developed successfully in linear progression--thus necessitate formative assessment along the trajectory of learning. Movements towards increased understanding (Hess, 2008). 17

18 How Could You Become An Expert in Misunderstanding? Take a backward designed problem-based approach to assessment With colleagues, agree on what you expect students to demonstrate at the point of graduation (summative assessment) At the point of matriculation use assessment as your baseline lens to identify patterns of initial difficulty (baseline assessment) At a point or points along the trajectory of learning use assessment as your formative lens to track and monitor student progress (formative assessment) 18

19 AAC&Us Quantitative Literacy Rubric Interpretation Ability to explain information presented in mathematical forms (e.g., equations, graphs, diagrams, tables, words) Representation Ability to convert relevant information into various mathematical forms (e.g., equations, graphs, diagrams, tables, words) Application/Analysis Ability to make judgments and draw appropriate conclusions based on the quantitative analysis of data, while recognizing the limits of this analysis 19

20 Assumptions Ability to make and evaluate important assumptions in estimation, modeling, and data analysis Communication Expressing quantitative evidence in support of the argument or purpose of the work (in terms of what evidence is used and how it is formatted, presented, and contextualized) 20

21 How Does this Commitment to Assessment Work ? Couple your outcomes with research or study questions such as What kinds of erroneous ideas, concepts, processes, or misunderstandings initially interfere with students abilities to reason quantitatively? How long do those ideas, concepts or misunderstandings persist and, thus, inhibit students abilities to develop enduring learning? 21

22 What approaches do successful and unsuccessful students take to solve problems that require quantitative reasoning? What strategies do student use to restructure intuitive, yet incorrect, approaches to solving problems that require quantitative reasoning? What conceptual or computational obstacles inhibit students from shifting from one form of reasoning to another form, such as from arithmetic reasoning to algebraic reasoning? 22

23 Why do students have difficulty transferring knowledge or skills from one course to another one or to another context? (approaches to tasks, incorrect concepts or constructs?) How well do stand-alone skills-based courses, such as mathematics courses, prepare students to integrate or apply those skills into future course work? 23

24 Identify or Design Assessment Methods That Provide Evidence of Product and Process Direct Methods, Including Some That Provide Descriptive Data about Students Meaning-Making Processes Indirect Methods, Including Some That Provide Descriptive Data about Students Meaning-Making Processes Institutional data (course taking patterns, for example) 24

25 Direct Methods to Learn about Learning Processes Think Alouds: Pasadena City College, How Jay Got His Groove Back and Made Math Meaningful(Cho and Davis) Word edit bubbles Observations in flipped classrooms Students deconstruction of a problem or issue (PLEs in eportfolios can reveal thistagging, for example) 25

26 Student recorders list of trouble spots in small group work or students identification of trouble spots they encountered in an assignment Results of conferencing with students Results of asking open-ended questions about how students approach a problem or address challenges 26

27 Analysis of chunks of work as part of an assignment because you know what will challenge or stump students in those chunks Use of reported results from adaptive or intelligent technology Focus on hearing about or seeing the processes and approaches of successful and not so successful students 27

28 Writing beyond what is visually presented during a lecture Identifying clues to help organize information during a lecture Evaluating notes after class Reorganizing notes after class 28 Note-taking and Study Strategies of Successful Students

29 Comparing note-taking methods with peers Using ones own words while reading to make notes Evaluating ones understanding while reading 29

30 Consolidating reading and lecture notes Sharing practices on how to organize, think, and memorize content Evaluating ones own understanding Monitoring the effectiveness of note- taking practices (Yu, 2010) 30

31 Some Indirect Methods that Probe Students Learning Experiences and Processes SALG (salgsite.org): Student Assessment of Their Learning Gains Small Group Instructional Design Interviews with students about their learning experiences, about how those experiences did or did not foster desired learning, about the challenges they confronted 31

32 1. Identify The Outcome or Outcomes You Will Assess 1. Identify The Outcome or Outcomes You Will Assess 5. Analyze and Interpret Students Work and Students Responses. 5. Analyze and Interpret Students Work and Students Responses. 4. Develop a Plan to Collect Direct and Indirect Assessment Results that Will Answer Your Question. 4. Develop a Plan to Collect Direct and Indirect Assessment Results that Will Answer Your Question. 2. State the Research or Study Question You Wish to Answer 2. State the Research or Study Question You Wish to Answer 3. Conduct a Literature Review about That Question. 3. Conduct a Literature Review about That Question. 6. Collaboratively Discuss Ways to Innovate Pedagogy or Educational Practices 6. Collaboratively Discuss Ways to Innovate Pedagogy or Educational Practices 7. Implement Agreed-upon Changes and Reassess. 7. Implement Agreed-upon Changes and Reassess. 8. Share Developments within and outside The Institution to Build Knowledge about Educational Practices. 8. Share Developments within and outside The Institution to Build Knowledge about Educational Practices. A Framework for Planning Backwards 32

33 Soft Times and Neutral Zones 33

34 What if we…. Collaboratively use what we learn from this approach to assessment to design the next generation of curricular and co-curricular design, pedagogy, instructional design, educational practices, and assignments to help increasingly more students successfully pass through trouble spots or overcome learning obstacles; 34

35 And, thereby, collaboratively commit to fostering students enduring GE learning in contexts other than the ones in which they initially learned. 35

36 Start Early 36

37 Dig Deeply 37

38 Innovate Systemically 38

39 Works Cited Cho, J. and Davis, A Pasadena City College. How Jay Got His Groove Back and Made Math Meaningful Hess, K Developing and Using Learning Progressions as a Schema for Measuring Progress. National Center for Assessment, Land, R., Meyer, J.H.F., and Smith, J. Eds Threshold Concepts and Transformational Learning. Rotterdam: Sense Publishers. Maki, P nd Ed. Assessing for Learning: Building a Sustainable Commitment Across the Institution. VA: Stylus Publishing, LLC National Research Council Knowing What Students Know: The Science and Design of Educational Assessment. Washington, D.C. Yu, C. Y. Learning Strategies Characteristic of Successful Students. Maki, P p


Download ppt "What If… Peggy Maki Education Consultant Specializing in Assessing Student Learning Presented at AAC&Us GE and Assessment Conference, Boston, March 1,"

Similar presentations


Ads by Google