1. Topic #3 - CRITICAL THINKING Key Evidence 1 Provided by Amarillo College Offices of Institutional Research and Outcomes Assessments

2. Critical Thinking: General Education Competency Amarillo College uses an embedded assessment approach across the college to assess four general education competencies including critical thinking. Instructors from all areas/campuses submit student work for assessment. Target is to assess100 samples of student work per year. 2

3. Critical Thinking Rubric Standards Upon completion of a minimum of 30 credit hours taken at Amarillo College, a student should be able to demonstrate the successful application of higher order analytical and creative cognitive processes. Benchmark: 60% of students must attain a rubric level of 3 or better Assess the assigned task as: –Exemplary (5) –Excellent (4) –Competent (3) –Needs work (2) –Unacceptable (1) 3

4. Explanation of Critical Thinking Rubric: 60% will score in 3, 4 or 5 5 (Exemplary) Consistently does all or almost all of the following: Innovative interpretation of evidence, statements, graphics, questions, etc. Identifies exceptional arguments (reasons and claims) pro and con. Presents superior explanations of complex analyses and values alternative problem-solving methods. Draws well-supported, logical conclusions which follow a logical chain of thought. Follows the evidence and creatively presents clear, unambiguous conclusions from the evidence and reasons presented. 4 (Excellent) Consistently does all or almost all of the following: Accurately interprets evidence, statements, graphics, questions, etc. Identifies the salient arguments (reasons and claims) pro and con. Thoughtfully analyzes and evaluates major alternative points of view. Draws warranted, judicious, non-fallacious conclusions. Justifies key results and procedures, explains assumptions and reasons. Fair-mindedly follows where evidence and reasons lead. 3 (Competent) Does most or many of the following: Accurately interprets evidence, statements, graphics, questions, etc. Identifies relevant arguments (reasons and claims) pro and con. Offers analyses and evaluations of obvious alternative points of view. Draws warranted, non- fallacious conclusions. Justifies some results or procedures, explains reasons. Fair-mindedly follows where evidence and reasons lead. 4

5. Explanation of Critical Thinking Rubric (cont.) 2 (Needs work)Does most or many of the following: Misinterprets evidence, statements, graphics, questions, etc. Fails to identify strong, relevant counter-arguments. Ignores or superficially evaluates obvious alternative points of view. Draws unwarranted or fallacious conclusions. Justifies few results or procedures, seldom explains reasons. Regardless of the evidence or reasons, maintains or defends views based on self-interest or preconceptions. 1 (Unacceptable) Consistently does all or almost all of the following: Offers biased interpretations of evidence, statements, graphics, questions, information, or the points of view of others. Fails to identify or hastily dismisses strong, relevant counter-arguments. Ignores or superficially evaluates obvious alternative points of view. Argues using fallacious or irrelevant reasons, and unwarranted claims. Does not justify results or procedures, nor explain reasons. Regardless of the evidence or reasons, maintains or defends views based on self –interest or preconceptions. Exhibits close-mindedness or rigid thinking. 5

6. Assessment of General Education Competency: Critical Thinking Findings Goal (Benchmark): –60% of 100 students will score a 3 or higher (“competent”) Results: –2007-2008 (N=91) ** 96% of students scored a 3 or higher –Scoring system was changed mid-year –2008-2009 (N=97) ** 95% of students scored a 3 or higher ** Met goal but no specific strengths or suggestions for improvements provided No specific strengths or suggestions for improvements provided o specific strengths or suggestions for improvements provided 6

7. Assessment of General Education Competency: Critical Thinking Scores Committee Evaluation Exemplary (5) Excellent (4) Competent (3) Needs Work (2) Unacceptable (1) # Students Assessed Yr: 2007-2008 5572540 91 5% 63%27%4%0% Yr: 2008-2009 18571741 97 19% 59%18%4%1% No specific strengths or suggestions for improvements provided 7

8. Community College Survey of Student Engagement (CCSSE) 2009 Results for Amarillo College relevant to Critical Thinking 8

9. CCSSE Faculty/Student Responses StatementFacultyStudents During the current school year, how much does the coursework in your selected course section emphasize memorizing facts, ideas, or methods so students can repeat them in pretty much the same form Very Little13%8% Some32%30% Quite a bit37%38% Very Much18%25% During the current school year, how much does the coursework in your selected course section emphasize analyzing the basic elements of an idea, experience, or theory Very Little4%6% Some15%30% Quite a bit49%43% Very Much32%20% During the current school year, how much does the coursework in your selected course section emphasize synthesizing and organizing ideas, information, or experiences in new ways Very Little4%9% Some25%35% Quite a bit41%38% Very Much30%18% How often do students in your selected course section work on a paper that requires integrating ideas or information from various sources Never29%21% Sometimes29%34% Often23%32% Very Often19%13% 9

10. CCSSE Faculty/Student Responses (cont.) StatementFacultyStudent During the current school year, how much does the coursework in your selected course section emphasize making judgments about the value or soundness of information, arguments, or methods Very Little11%17% Some29%36% Quite a bit38%33% Very Much22%14% During the current school year, how much does the coursework in your selected course section emphasize applying theories or concepts to practical problems or in new situations Very Little4%12% Some26%36% Quite a bit35%36% Very Much35%17% During the current school year, how much does the coursework in your selected course section emphasize having students use information they have read or heard to perform a new skill Very Little10%8% Some23%34% Quite a bit34%37% Very Much34%21% 10

11. CCSSE Faculty/Student Responses (cont’d) StatementFacultyStudent To what extent do students' experiences in your selected course section contribute to their knowledge, skills, and personal development in thinking critically and analytically None1% 0% Very little3%4% Some9%22% Quite a bit39%43% Very much48%31% To what extent do students' experiences in your selected course section contribute to their knowledge, skills, and personal development in solving numerical problems None20% 0% Very little25%7% Some17%21% Quite a bit13%39% Very much25%32% 11

12. CCSSE AC Students to Large Colleges and all CCSSE Cohorts Statement ACLarge Colleges CCSSE Cohort How often do students in your selected course section work on a paper that requires integrating ideas or information from various sources Never21.1%11.1%11.2% Sometimes33.9%28.3%28.7% Often32.2%37.2% Very often12.9%23.4%23.0% During the current school year, how much does the coursework in your selected course section emphasize analyzing the basic elements of an idea, experience, or theory Very little6.2%4.8%5.0% Some30.3%27.5%28.4% Quite a bit43.5%43.3%43.1% Very much20.1%24.4%23.5% During the current school year, how much does the coursework in your selected course section emphasize synthesizing and organizing ideas, information, or experiences in new ways Very little9.2%7.8%7.5% Some35.1%33.0%33.5% Quite a bit37.5%38.4%38.7% Very much18.2%20.8%20.4% During the current school year, how much does the coursework in your selected course section emphasize making judgments about the value or soundness of information, arguments, or methods Very little16.7%12.7%12.4% Some35.9%36.0%36.5% Quite a bit33.3%34.0%34.1% Very much14.1%17.4%17.0% 12

13. CCSSE AC Students to Large Colleges and all CCSSE Cohorts Statement ACLarge Colleges CCSSE Cohort During the current school year, how much does the coursework in your selected course section emphasize having students use information they have read or heard to perform a new skill Very little8.1%9.7%8.9% Some33.9%30.8%30.5% Quite a bit 36.8%35.6%36.1% Very much 21.2%23.9%24.5% To what extent do students' experiences in your selected course section contribute to their knowledge, skills, and personal development in thinking critically and analytically Very little3.5%7.0%6.4% Some21.8%25.8%25.2% Quite a bit 43.4%41.1%41.8% Very much 31.2%26.1%26.6% To what extent do students' experiences in your selected course section contribute to their knowledge, skills, and personal development in solving numerical problems Very little7.2%17.0%16.1% Some21.0%29.4%29.3% Quite a bit 39.4%33.0%33.7% Very much 32.4%20.7%20.9% During the current school year, how much does the coursework in your selected course section emphasize applying theories or concepts to practical problems or in new situations Very little11.5%10.4%10.0% Some36.4%34.0%34.2% Quite a bit 35.5%35.4%35.8% Very much 16.6%20.2%20.0% 13

14. Mean Scores Compared to Large Colleges * AC average score was significantly different when compared to other large colleges. 14 StatementAC Mean Large College Sig* During the current school year, how much has your coursework at this college emphasized the following mental activities? (1=Very Little, 2=Some, 3=Quite a bit, 4=Very much) Memorizing facts, ideas, or methods from your courses and readings so you can repeat them in pretty much the same form 2.802.82 Analyzing the basic elements of an idea, experience, or theory2.772.87 Synthesizing and organizing ideas, information, or experiences in new ways 2.652.72 Making judgments about the value or soundness of information, arguments, or methods 2.452.56 Applying theories or concepts to practical problems or in new situations 2.572.65 Using information you have read or heard to perform a new skill2.712.74 How much has your experience at this college contributed to your knowledge, skills, and personal development in the following areas? (1=Very little, 2=Some, 3=Quite a bit, 4=Very much) Thinking critically and analytically3.022.86 Solving numerical problems2.972.57*

15. Questions Kara Larkan-Skinner Director of Outcomes Assessments kdlarkanskinner@actx.edu Copyright Amarillo College 2009