1. © 1998, The California Academic Press, Millbrae, CA. Critical Thinking: Assessment Ideas Peter A. Facione Noreen C. Facione Santa Clara U UC San Francisco

2. © 1998, The California Academic Press, Millbrae, CA. Frame the problem in terms of student learning Alt # 2: How well are the students learning the things we expect of them? Alt #1: How well are we teaching the things that we hope our students will learn?

3. © 1998, The California Academic Press, Millbrae, CA. In the Classroom Every assignment that engages students in using their critical thinking can be converted into a tool for assessing the quality of that thinking.

4. © 1998, The California Academic Press, Millbrae, CA. To Assess CT ¶Engage people in purposeful, thoughtful problem-solving. ·Make manifest their thinking skills and habits of mind. ¸Capture the evidence of their thinking, either qualitatively or quantitatively. ¹On that evidence, evaluate the relative strengths or weaknesses of that thinking.

5. © 1998, The California Academic Press, Millbrae, CA. The application of cognitive skills to make judgments about the definition of problems and the exploration of options.

6. © 1998, The California Academic Press, Millbrae, CA. To Measure CT Skills California Critical Thinking Skills Test (CCTST) yDelphi / US Dept of Education Study yCaptures gains at all class levels y34 multiple choice items yClassroom administration yDiscipline neutral

7. © 1998, The California Academic Press, Millbrae, CA. Entry CCTST and SAT Correlations Facione,N. (1997). Nursing Aggregate Data Analysis Study

8. © 1998, The California Academic Press, Millbrae, CA. Significant correlation with other standardized measures Facione,N. (1997). Nursing Aggregate Data Analysis Study

9. © 1998, The California Academic Press, Millbrae, CA. Other Measures CT Skills zThe Test of Everyday Reasoning zCalifornia Reasoning Appraisal

10. © 1998, The California Academic Press, Millbrae, CA. To Measure CT Dispositions California Critical Thinking Disposition Inventory (CCTDI) yDelphi/US Dept of Education Study yPersonality construct yNative language availability yClassroom administration y75 items /7 scales yDiscipline neutral

11. © 1998, The California Academic Press, Millbrae, CA. The consistent internal motivation to solve problems and make decisions by thinking.

12. © 1998, The California Academic Press, Millbrae, CA. Typical Profile of 18 Year Old Frosh Class CCTDI Means

13. © 1998, The California Academic Press, Millbrae, CA. Truth-Seeking Truth-seeking: the courageous desire for best knowledge in a context; asking hard questions and and following reason and evidence wherever they lead.

14. © 1998, The California Academic Press, Millbrae, CA. Very few really seek knowledge in this world. Mortal or immortal, few really ask. On the contrary, they try to wring from the unknown the answers they have already shaped in their own minds -- justifications, explanations, forms of consolation without which they cannot go on. To really ask is to open the door to the whirlwind. The answer may annihilate the question and the questioner. Marius the Vampire, from Anne Rice, The Vampire Lestat

15. © 1998, The California Academic Press, Millbrae, CA. Fundamental Perspective for Assessment Research zWhat do we intend that our students should learn as a result of their educational experience in our institution? zHow can we know how well the students, as a group, are doing in achieving those learning goals?

16. © 1998, The California Academic Press, Millbrae, CA. Educational Assessment Seven Vital Questions ÀHow can these findings improve student learning? ÁWhat is the fair-minded interpretation of the data? ÂHow will the best possible data be obtained? ÃWhat would count as valid and reliable data? ÄWhich learning goal(s) shall be assessed? ÅWhat do key stakeholders fear, expect? ÆWhy is this assessment research being done?

17. © 1998, The California Academic Press, Millbrae, CA. The Professional Judgment Rating Form Novice /Internship Level zPerformance evaluation of thinking zIncorporates both skills and dispositions zUse in work sites to evaluate trainees and novice professionals

18. © 1998, The California Academic Press, Millbrae, CA. Other CT Assessment Tools Holistic Critical Thinking Scoring Rubric zRate written or oral presentations zThinking Skills and Dispositions

19. © 1998, The California Academic Press, Millbrae, CA. The parameters of the anticipated critical thinking situation dictate the breadth and variety of both the instructional and the assessment contexts. Framing the standard:

20. © 1998, The California Academic Press, Millbrae, CA. Critical thinking - purposeful self-regulatory judgment - can be... zAssessed zLearned zTaught zDefined