Developing Operational Outcomes for Your Unit Dr. Kim Yousey-Elsener, Associate Director of Assessment Programs

Goals of this session: Defining “operational” outcomes Connecting outcomes “up” Connecting outcomes with assessment types Writing effective outcomes Measuring outcomes

Defining “Operational” Outcomes

Program OperationalTargetMetrics Criteria for success

Success indicators “…are quantifiable measurements, agreed to beforehand, that reflect the critical success factors of an organization. They help an organization define and measure progress toward organizational goals.” (Bresciani et al., 2010)

Determine the type of Outcome: Examine what a student (or other stakeholders) is to know, think or be able to do, as a result of the program, course, service. Learning outcomes Examine what a program or process is to do, achieve or accomplish for its own improvement; generally needs/satisfaction driven. Operational outcomes

Connecting “Up”

Where is your inspiration? Program & Policy Creation or Improvement Improved Teaching and Learning Planning & Resource Allocation Accountability & Accreditation

Start with your “foundations” Strategic Plan Priorities Mission statement Resource Needs New programs/services Anything needing a change Political quandaries

Let’s get started… What is your source of inspiration? What do you need to find out?

Types of assessment: Assessment UsageNeeds Program effectiveness Environment Learning Comparison Cost

Writing effective outcomes

ABCD Structure of an Outcome (Heinich, et al, 1996) Who or what does the outcome pertain to? Audience/Who What do you expect to change? Learning – students do, think, feel Operational - need, effectiveness, etc. Behavior/What Under what conditions or circumstances will the change occur? Condition/How How much will be accomplished, and to what level? Degree/How much

Outcome Statement: A B C D Program/Service will …

Let’s Practice!! A B C D Program/Service will …

Measuring outcomes

Sources of evidence Data systems Tracking/Usage Operational data Trend/longitudinal data Local surveys National surveys Rubrics Objects

Evidence source: Data systems

Evidence source: Tracking systems

Evidence source: Operational data

Evidence source: Local survey

Evidence source: National survey

Evidence source: Rubric

Evidence Source: Objects

Let’s Practice!! Who is your audience? What kind of data will you need for that audience? In what format? What source would help you achieve that?

Questions? Kim Yousey-Elsener, PhD. Associate Director, Campus Labs press 1