Report from a project funded by the Teagle Foundation to Beloit, Knox, Monmouth, Ripon Marion Fass, Kevin Hastings, Frank Gersich, Robin Woods

 “[R]ather than divide the undergraduate experience into separate camps, general versus specialized education, the curriculum of a college of quality will bring the two together.” Ernest Boyer  We proposed a collaborative project to examine this complementary relationship between general education and the major, and, in particular, to establish methods of assessment that allow us to learn about, improve, and strengthen the achievement of liberal learning goals by all of our students, irrespective of the major they choose.

 How do departments contribute to students’ achievement of all college goals? Do departments see their contributions in the same way?  Faculty from Beloit, Knox, Monmouth and Ripon are exploring  how departments define and teach critical thinking, quantitative reasoning and civic engagement, and  how they measure the successes of students in reaching their educational goals.

 As expected, quantitative reasoning in Philosophy differs from that in Mathematics, but what about critical thinking?  We will discuss some of our experiences and findings, and identify issues that are important in our ongoing efforts at assessment.

 Align learning goals with mission, general education goals and with major ◦ Our institutions varied in amount of structure in general education program  Look at how general education goals are enhanced by the major and by advising  Develop systems for feedback  Share among the participating colleges, at institutional and departmental levels  None of our colleges have Center for Teaching and Learning

 What do we know about what we do on each campus? ◦ NSSE ◦ Collegiate Learning Assessment  What do we want to share between campuses?

 Each department developed a plan, but not all the same plan  What are the basic criteria for plans?  Strategies ◦ Focus groups ◦ Review of student work and transcripts ◦ Links to NSSE, CLA ◦ Embedded assessments ◦ Logs of advising

 Civic engagement  Quantitative reasoning  Critical thinking  How do we measure these?  We let the departments decide, based on their needs and their disciplinary orientations.

InstitutionYear OneYear Two BeloitPhilosophy/ Religion Anthropology Biology Psychology KnoxMathematics English Education Economics RiponPhysics Sociology/Anthrop ology French Economics MonmouthArt Biology Communications and Theater Arts Accounting

 Explore the role of major courses and advising in assuring that students ◦ Achieve depth in a disciplinary or interdisciplinary area ◦ Develop skills of liberally educated individual ◦ Connect with co-curricular and experiential  Identify how to use this information to improve student academic experiences

1. Review course structure and content. 2. Examine the sequencing of courses; 3. Identify patterns of elective course selection by majors 4. Survey about co-curricular activities to identify if/how those activities are consistent with discipline and general education goals; 5. Review and devise methods of assessment used in major; 6. Identify actions to strengthen the major and the students’ total educational experiences

At the heart of the educational process Critical thinking asks students to engage actively in their own learning

 As many definitions as departments, but all see it as a central part of what we do: ◦ “This is the area where we found the most assumptions and took the most for granted, given that we believe this concept to be at the very heart of every single thing toward which the English Department strives.” (Knox) ◦ Some see it as rooted in the discipline (Anthropology, Beloit); ◦ Others as more open, usually as process (Sociology, Ripon)  All departments chose to examine critical thinking

 Eight different departments=eight different definitions  Despite differences, all departments see critical thinking as essential to what they do, and as a constitutive element of their disciplines and of a liberal education  Most definitions include two essential components: ◦ Perception: seeing the subject clearly ◦ Analysis: questioning the subject

 Beloit: goals statement includes logical thinking and problem-solving  Knox: goals statement includes the critical exchange of ideas and demands for rigorous thinking  Monmouth: one of five educational elements identified in all-college gen ed goals  Ripon: all-campus discipline-based model: all departments required to have plan and assessment procedures in place 

 Beloit Religion: ◦ students’ ability to think critically about religious thought and practice  Ripon Anthropology: extrapolates from mission statement: ◦ Comparative thinking and analysis; contextual understanding of human behavior; ◦ awareness of the effects of study on object of study  Ripon Physics: from divisional mission: ◦ hypothesis formation and testing ◦ original research

 Direct measures of student learning: embedded assignments, writing/ portfolio analysis  Indirect measures: student surveys (Beloit Religion:  Students responsible for gauging their own progress),  Course evaluations

 Monmouth Art: measures over time  Beloit Religion: students responsible for measures of progress  Ripon Physics: specific gains in knowledge  What does the CLA tell us?

◦ “We are committed to the idea that thinking critically involves being able to recapitulate a line of reasoning and engage in dialogue, raising objections and concerns, to see if that reasoning approaches truth.” (Philosophy Department, Beloit) ◦ “Drawing on the work of other scholars….the sociology department defines critical thinking as thinking that requires students to evaluate and interpret evidence, identify and evaluate relevant arguments, develop and defend a position on an issue, and/or consider all sides of a question or issue without bias.” (Sociology Department, Ripon)

◦ ….We are not always conscious of thinking critically, that is, engaging with texts to assess both for their value and their meaning. To assess a text for value and meaning requires marshalling evidence from the text itself, employing logical reasoning, being attentive to emotional and psychological charges of the text, and considering relevant connections between the text and the larger world in which it is produced.” (English Department, Knox)

 …We believe that by its very nature, anthropology is inherently about critical thinking. Cultural anthropology works to make the strange familiar and the familiar strange. To do this, students must question their basic assumptions and in questioning these assumptions they engage in critical thought.” (Anthropology Department, Beloit)

 Quantitative literacy ◦ Graphs, charts ◦ Basic life skills math  Logical problem solving ◦ Systematic analysis  Mathematical skills ◦ Statistics ◦ Mathematics  Integration of literacy, problem solving, using appropriate tools correctly

 NSSE and other surveys ask students to self- report,  This assumes that this is one of the most measurable educational goals.  This project demonstrates, however, that a wide campus discussion is necessary to reinforce the need for this particular liberal education outcome, and to decide what it means. We don’t really agree.

 Interpret mathematical models such as formulas, graphs, tables, and schematics, and draw inferences from them.  Represent mathematical information symbolically, visually, numerically, and verbally.  Use arithmetical, algebraic, geometric and statistical methods to solve problems.  Estimate and check answers to mathematical problems in order to determine reasonableness, identify alternatives, and select optimal results.  Recognize that mathematical and statistical methods have limits.

 Out of our discipline, ◦ but value Logical Problem Solving- ◦ But Life Skills are critical to success  Would be nice, not required ◦ (how to measure baseline, success?)  Important to our discipline, require courses ◦ Taught by other departments, like Mathematics ◦ Taught by “our” department, Social Statistics  Central to disciplinary mastery ◦ Physics, Mathematics

 As long as you abstract from the specific to the general by representing a system or process symbolically (which is abstracting), setting down rules for it and manipulating that symbol system within those rules, it is quantitative. (Chemistry reaction equations? Logic? Language syntax?) ◦ (Kevin Hastings, 2008)

 Having students approach problems and projects and think of them in quantitative ways (CLA)  Rational/ symbolic analysis  Review writing to diagnose whether students are applying quantitative techniques. ◦ If bold statements are made, are they willing to support with data?(Carleton approach)  Develop disciplinary measures when appropriate

Civic Engagement Broadly defined: preparing students to be involved in their community –Formal curriculum –Co-curriculum –Volunteer activities –Student/Faculty research Participating departments “wrestled” with definition for study

College Goals Include Beloit  One of seven curricular goals is: “Active, responsible citizenship.” Knox  One of four curricular goals is: “applying classroom learning through hands-on experience.” Monmouth  General Education Capstone course: Citizenship (informed, conscientious action) Ripon  Communicating Plus Program supports engagement in issues confronting citizens of the 21 st century.

Civic Engagement Participation and Assessment Level of CE in formal curriculum may be dependent upon resources Departmental commitment to CE may be dependent upon campus priorities Assessment of CE outside of formal curriculum often is student reported participation levels Assessment of CE within formal curriculum may best be through “guided” participant reflections

CE in First-round Reports One department in first round included CE as part of departmental mission – focused on community service Six departments discussed role of preparing students to act (generally through ethics/values discussions) Two departments indicated a need to incorporate into future assessments One department collected information about student involvement in activities outside of departmental courses

HumanitiesCivic Engagement Knox English “how to respect the opinions, and emotions, the thoughts and articulations of others, thus preparing students for broader engagement at the civic and moral level.” Engage with artists and scholars beyond the classroom, participate in community of scholars in journals, readings, etc. Beloit Philosophy Preparation to act through applied ethics courses Beloit Religious Studies Address directly questions of how communal values are shaped, communicated, and contested. Helping students to cultivate a sense of responsibility as developing global citizens, and a sense of wonder about religious experiences and frames of reference. Evaluate by course evaluations. Monmouth Art Civic engagement student survey given as part of review process, including voting and art-related events on campus

Social Sciences Civic Engagement Ripon Sociology Not systematically assessed – will do in Fall 2008 All students reported 2 to 4 activities Ripon Anthropology Used embedded assessments ethical perspectives on anthropology in community – Need to be more explicit in curriculum Beloit Anthropology Couldn’t agree on definition – Exposed to tools and ethical considerations in classes, faculty model engagement, students study abroad, Nicaragua class, “pragmatic solidarity”

SciencesCivic Engagement Ripon Physics Part of departmental mission, including Learning about and sharing information about the applications of physics to issues in society (e.g., energy conservation) and Community service in the form of sharing physics activities with others, especially school children and their teachers. Knox Mathematics Outlined civic engagement, through requirement and will verify with NSSE Monmouth Biology Through investigative case-based learning. Will assess when implemented.

Conclusions and recommendations

 We all agree that these are important goals, but we don’t agree on how they are defined  There are legitimate differences between disciplines Someone who thinks critically as a biologist may differ from someone who thinks critically as a philosopher ◦ By giving students “majors” on their diplomas we acknowledge this  These findings can catalyze important all college discussions about shared values, essential skills and disciplinary interpretation

 Departments are at different levels of readiness to take on review ◦ Personalities, changes in discipline ◦ Departments need periodic retreats to revisit goals and courses articulation ◦ Goals may have been set before working faculty arrived, departments split in programs  Departments that depend on the “kindness of others” to meet skill needs of majors need to sit down and talk about expectations

 Smallness doesn’t preclude need to discuss and review  “Friendly” departments may not always discuss educational issues  Because of desire for flexibility in departments, students don’t always take courses in sequence-  This increases need for communication about goals and how they are reinforced in curriculum

Our college graduate with liberal arts skills framed by disciplinary orientations Student Educational Experience

 Resources ◦ Assessment committees ◦ Centers for teaching and learning ◦ Administrative  Recognition  Links of course, curriculum and mission

 Thanks to the Teagle Foundation for supporting this work and to ACM FaCE, Lake Forest College and Rachel Ragland for inviting us to speak at this conference  Thanks to Kevin Hastings at Knox who has worked with us on this project, but couldn’t be here today.