Assessing General Education February 14, 2002 Developing General Education Goals and Objectives

Overview Topics Covered in this Workshop zReview of the Assessment Process yDefinitions, Overview of Process and Sequence zAssessing Goals and Objectives yRationale: Why Articulate Goals and Objectives? yDefining Key Terms ySources of Goals and Objectives yTypes of Goals yGuidelines for Writing Goals and Objectives yChecklist for Evaluating Your Goals and Objectives ySample General Education Goals and Objectives zPractice Writing Goals and Objectives

Defining Assessment z “…assessment refers to systematic attempts to gather information about what students have learned, to discern meaningful interpretations from that information, and to use the information to improve our programs…”

Defining Assessment z“…good practice in (assessment) occurs when we ask, ‘what are students learning from our programs, and how can their learning be enhanced?’…” xACPA and NASPA Principles of Good Practice, 1997)

The Assessment Process: Overview of the Sequence  State the broad educational mission (purposes) and goals of the program  State the more specific objectives and intended educational outcomes of the program  Select appropriate assessment methods and measures; establish target criteria  Gather data using assessment methods & measures chosen  Analyze and interpret findings; report to stakeholders  Identify and implement any changes to the program  Revise assessment objectives, methods, measures, criteria as appropriate

Why Articulate Goals and Objectives? “If you don’t know where you’re going, you’ll probably end up somewhere else” Campbell, 1974

Why Articulate Goals and Objectives? yGoals and Objectives Provide Direction for all Instructional Activities yInforms Students about the Intentions and Priorities of the Faculty yGoal-Directedness as a Marker of Successful Individuals and Organizations yThe Importance of Modeling Goal-Setting and Goal-Directedness for our Students

Defining Key Terms: Mission, Goals, Objectives yStatements of Mission or Purpose Broad statements outlining institutional philosophy and character, as well as principal focus of the curriculum yGoals Statements regarding general aims or purposes of education Broad, long-range intended outcomes Used primarily in planning, policy-making, yObjectives Brief, more specific statements describing the intended learning outcomes of a program Focus is on features students expected to exhibit also known as, “intended learning outcomes”

Sample Mission, Goal, and Outcome Statements zSt. Norbert College (SNC Catalog, p. 10,12) xMission …SNC strives to provide an education that is personally, intellectually, and spiritually challenging. …(to sustain)…an environment that encourages all religions of the world to develop their full potential in understanding and serving the world xGoal(s) …to produce students (who) have the ability to come to grips with cultural change--to confront, to shape, and to grow with the future In the personal sphere…to help students clarify and develop their personal goals, achieve a sense of self-worth, gain a deeper level of self-understanding, and become open, honest, and trusting in their relationships with others In the area of moral development…to encourage students to clarify their own values and embrace their beliefs from personal conviction. (continued on next slide)

Sample Mission, Goal, and Outcome Statements zSt. Norbert College (SNC Catalog, p. 10,12) xGoal(s) In the intellectual realm…to make students self-educating people…to develop in students the ability to synthesize knowledge from various sources, and to train students in the methods of scholarly inquiry …students should (learn) that the methods and data necessary to solve problems vary with the nature of the problem and sometimes must be newly invented… …students should also have gained confidence in their abilities to work in this way xIntended Learning Outcomes (?)

Sample Mission, Goal, and Outcome Statements yGeneral Education Assessment for the Improvement of Student Academic Achievement (Nichols & Nichols, 2001) xMission (to ensure that) students can realize the full potential of their abilities and come to understand their responsibility for service in the human community xGoal Graduates will act in accordance with Judeo-Christian values xIntended Outcome Graduates of ABC College will behave in ways that demonstrate their commitment to commonly accepted Judeo-Christian values in their personal and professional lives

Sample Mission, Goal, and Outcome Statements zCollege of St. Scholastica xMission (of General Education program) …seeks to broaden students’ grasp of the accumulated wisdom of the past so that challenges of the present--racism, global conflict, injustice, dehumanization, spiritual emptiness--may be met with wisdom, faith, and imagination. xGoal(s) …to facilitate student learning in the following areas:...problem- solving, values-based decision making, social responsibility, effective communication, disciplinary understanding, the aesthetic response, and living with diversity xIntended Outcomes (see next slide)

Sample Mission, Goal, and Outcome Statements zCollege of St. Scholastica yIntended Learning Outcomes x(in the area of Values-Based Decision Making) The student will… –understand his/her own value system and how these values have been influenced by his/her personal experiences and decisions –differentiate between his/her personal values and the value systems of others –appraise personal and communal values in the light of new knowledge, recent experience, and insight –defend value-based decisions as ultimately serving the common good

Sample Mission, Goal, and Outcome Statements yIndiana University-Purdue University Indianapolis x(Mission)...every graduate of an IUPUI baccalaureate program should attain fundamental intellectual competence and ethical awareness in the area of…understanding society and culture… x(Goals) students should recognize their own cultural traditions and understand and appreciate the diversity of the human experience, both within the United States and internationally xIntended Learning Outcome students should demonstrate the ability (a) to compare and contrast the range of diversity and universality in human history, societies, and ways of life, (b) to analyze and understand the interconnectedness of global and local concerns, and (C) to operate with civility in a complex social world

Sample Mission, Goal, Outcome Statements yUniversity of South Carolina xMission …strives to educate graduates who are capable of excelling in their chosen fields, who are dedicated to learning throughout their lives, and who are responsible citizens in a complex society requiring difficult ethical and value-related decisions xGoals Students will become familiar with the diversity of a global culture marked by racial, ethnic, gender, and regional differences xIntended Learning Outcome Students will demonstrate the ability to... –Recognize multiple perspectives and appreciate perspectives which produce a world view different from one’s own –Use another perspective to analyze current or historical, social, and cultural events and practices

Sources of Goals and Intended Learning Outcomes yOpen Discussions…who are our ideal students? What can they do, what do they know, what do they value (at various points in the General Education program)? What achievements do you expect of General Education program graduates (career, lifestyle, citizenship, aesthetic appreciation)? What skills, knowledge, & values should they possess that will be necessary for entry level work or graduate study? yExisting Documentation College Catalog, General Education Handbook, syllabi, external versions of same

Ingredients of Goal and Outcome Statements yAssessable goals and intended learning outcomes state… xWhat is to be learned (knowledge,skills,values) xWhat level or form of learning is expected yExample xStudents will be able to apply logical and ethical principles to personal and social situations

What is to be learned? zKnowledge (what do students know?) xthe process by which a bill becomes a law zSkills (what can students do?) xcommunicate findings to two different audiences in written, oral, and visual formats zAttitudes (what do students believe and value?) xvalue exposure to diverse cultures as a part of their educational experience

Knowledge (Cognitive) Outcomes: Levels or Forms zKnowledge y(e.g.,define,describe, identify, list, match,recall) zComprehension (e.g., explain,paraphrase,summarize) zApplication (e.g., apply, relate, use in new situations) zAnalysis (e.g., compare/contrast, differentiate, analyze) zSynthesis (e.g., compose, create, design, produce) zEvaluation y(e.g., assess, critique, defend, grade, judge, prioritize)

Skill (Behavioral) Outcomes zGeneral Description xLearned observable behaviors zContexts and Areas of Application xPerforming arts, professional programs, technical/trade programs, athletics, etc. zSample skills xOral & written communication; presentation; interpersonal problem-solving; managerial, laboratory, music/art performance skills; critical thinking skills

Attitudinal (Affective) Outcomes zCategories (Krathwohl et al. 1964) xattitudes, beliefs, values, goals, expectations, interests, appreciation of…(person, object, goal, place) zPotential Problems xCan’t be measured directly, often inconsistent w/ behavior, disagreement over conceptual, operational definitions zBenefits xAn indication of the status, development of values and beliefs

Sample Affective Outcomes yStudents… x…will value opportunities to learn through diverse experiences x..will appreciate the beauty of creation x…will value the artistic dimensions of human experience x…will express confidence in and commitment to their values (all of the above from Loras College) x..will appreciate the value of exposure to those from diverse cultures as a part of their formal educational experience x…will express confidence in their ability to… x…acknowledge that the College has helped them...

Guidelines for Evaluating Intended Learning Outcomes yAre they framed in terms of what students should know, do, and value or believe? yAre they characterized by clear and simple language? Action verbs? yAre the intended outcomes reasonable, achievable? yAre they assessable? by multiple methods? yIs their consensual agreement among colleagues concerning the outcomes? yAre the outcomes important ones?

Concluding Remarks yGoals and Outcomes Need not Reflect Present xcan reflect hopes, future; serve as guide yNot all Actual Outcomes are the Intended or Expected Ones xside effects & surprises can be informative yAny Progress is Better than Inertia or Regression xdon’t wait for “perfect” goals or objectives

SNC General Education Program: Area 1 (Upper and Lower Biennium) xBroad General Education goals students will become more aware of the Judeo-Christian heritage, especially as developed in the Catholic Christian tradition; …will recognize differences and similarities between their own and other Christian and non-Christian religions; …will identify their own moral and religious convictions; …will recognize the moral issues involved in making human choices; …will exercise their duties as citizens through responsible participation in the social, political, and economic processes of daily life xArea 1 Lower Biennium students will develop a deeper understanding of the Catholic Christian heritage and other religious traditions to help them clarify their values in the context of the Christian tradition xArea 1 Upper Biennium students will become more aware of the Judeo-Christian heritage, especially as developed in the Catholic Christian tradition, will recognize the diversity and similarities between their own and other Christian and non-Christian religions, and will be able to identify their own moral and religious convictions

Sample Learning Outcomes: Area 1 …(context)…students will be able to recognize and articulate the values that underlie the Catholic Christian tradition …will be able to recognize and articulate the values underlying and affecting decisions, interpretations, analyses and evaluations made by themselves and others (Loras College, IA) …will be able to analyze their own values in efforts to respond to ethical dilemmas and offer solutions to moral problems (Loras College, IA)..will demonstrate in their behavior their commitment to commonly accepted Judeo-Christian values …will be able to understand ethical principles and apply them to personal and social situations involving ethical dilemmas or moral problems …students’ appreciation of the values underlying the Catholic Christian tradition will be reflected in their attitudes and positions on major social issues …appreciate, understand, and evaluate historical, philosophical, and ideological foundations of human values (Shepherd College, WV)

More Sample Outcomes: Area 1 yCollege of St. Scholastica xOutcome area: Social Responsibility The student will… –identify specific issues that call for socially responsible action –understand and evaluate the complexity of social justice –identify and evaluate differing points of view on the issue of social responsibility –evaluate the moral and social obligations to respond to injustice and to work for social change

SNC General Education Program: Areas 7 and 11 xBroad General Education Goals students will achieve an awareness of of the continuity and diversity of human experience; will develop an awareness of the continuity of old and new, past and present, far and near; will become aware that heritages other than their own exist and become more familiar with the unique heritages of others students will understand that we share the world with people who have unique heritages of their own and that ours is not the only one xArea 7--Lower Biennium students will develop a deeper understanding of the world’s diverse heritages and peoples through a study of their languages, history, literature, and/or culture xArea 11--Upper Biennium students will become aware of the relationships between the developing and the more developed world, and of issues or themes of international significance

Sample Learning Outcomes: Areas 7 and 11 students should demonstrate the ability (a) to compare and contrast the range of diversity and universality in human history, societies, and ways of life, (b) to analyze and understand the interconnectedness of global and local concerns, and (C) to operate with civility in a complex social world (IUPUI) Students will demonstrate the ability to... –Recognize multiple perspectives and appreciate perspectives which produce a world view different from one’s own –Use another perspective to analyze current or historical, social, and cultural events and practices (University of South Carolina) The student will (a) identify challenges posed by living and working in a multicultural nation and in a world community, (b) will comprehend how ethnicity, race, class, and gender have contributed to the shaping of personality and American cultures, and ( c) comprehend how the assumptions and values of other people provide a framework for making choices that can be valuable to the student’s own assumptions and values (College of St. Scholastica)

Sample Learning Outcomes: Areas 7 and 11 students should demonstrate the ability (a) to compare and contrast the range of diversity and universality in human history, societies, and ways of life, (b) to analyze and understand the interconnectedness of global and local concerns, and (C) to operate with civility in a complex social world (IUPUI) Students will demonstrate the ability to... –Recognize multiple perspectives and appreciate perspectives which produce a world view different from one’s own –Use another perspective to analyze current or historical, social, and cultural events and practices (University of South Carolina) The student will (a) identify challenges posed by living and working in a multicultural nation and in a world community, (b) will comprehend how ethnicity, race, class, and gender have contributed to the shaping of personality and American cultures, and ( c) comprehend how the assumptions and values of other people provide a framework for making choices that can be valuable to the student’s own assumptions and values (College of St. Scholastica)

SNC General Education Program: Skills in Critical Thinking yCollege-Wide Goal(s) (SNC Catalog, p. 10,12) In the intellectual realm…to make students self- educating people…to develop in students the ability to synthesize knowledge from various sources, and to train students in the methods of scholarly inquiry …students should (learn) that the methods and data necessary to solve problems vary with the nature of the problem and sometimes must be newly invented… yBroad General Education Goals …students should be able to integrate knowledge from a variety of sources...

Samples Learning Outcomes: Critical Thinking Students will be able to clarify, analyze, evaluate and extend arguments Students will demonstrate the ability (a) to analyze complex issues and make informed decisions, (b) to synthesize information in order to arrive at reasoned conclusions, (C) to evaluate the logic, validity, and relevance of data, (d) to solve challenging problems, and (e) to use knowledge and understanding in order to generate and explore new questions (IUPUI) Students will be able to analyze logical connections among facts, goals, and implicit assumptions relevant to a given problem or claim, and to generate and evaluate the implications which follow from them (Loras College) Students will be able to differentiate arguments from evidence and to evaluate the strengths and weaknesses of the arguments and the evidence used to support competing positions on major issues