1. Outcomes Based Evaluation
The A-Team: Susan Genden
Sanders Hamson
Tara McCoy
Deborah Stroud
Jeff Trzeciak
FALL 2005
ATEAM

2. Outcomes Based Evaluation
Let’s Review from module two:
Traditionally, libraries have written objectives that define what will be produced, implemented, provided, or developed.
FALL 2005
ATEAM

3. Outcomes Based Evaluation
Typically, the evaluation approach is to monitor these objectives using library-centric measures known as outputs to document the amount, quality, or volume of and use of the project's products or services.
FALL 2005
ATEAM

4. Outcomes Based Evaluation
Today, the preference is to judge programs based on outcomes.
Outcome-based evaluation, sometimes called outcomes measurement, is a systematic way to determine if a program has achieved its goals.
FALL 2005
ATEAM

5. Outcomes Based Evaluation
Why use outcomes?
Outcomes look at results.
Outcomes describe changes or benefits for individuals in the form of knowledge, skills, attitudes, behavior, status or life conditions because they participated in library services.
FALL 2005
ATEAM

6. Outcomes Based Evaluation
Outcomes-based evaluation allows institutions to:
articulate and establish clear program benefits (outcomes);
identify ways to measure those program benefits (indicators); and
clarify the specific individuals or groups for which the program's benefits are intended (target audience).
By using outcomes-based evaluation, we can design program services to reach that audience and achieve the desired results.
FALL 2005
ATEAM

7. Outcomes Based Evaluation
Outcomes-based evaluation focuses on the key questions:
“How has my program made a difference?”
“How are the lives of the program participants better as a result of my program?”
For example: People will read with their children more often.
NOT: How many books circulated, how many reference questions were answered? (Though these are not bad numbers to collect!) These are Outputs.
FALL 2005
ATEAM

8. Outcomes Based Evaluation
How do I develop outcomes-based evaluation statements?
Step One:
Set the targets. These will drive what you do.
FALL 2005
ATEAM

9. Outcomes Based Evaluation
Case Study:
Using the case study in activity two, what is the target?
students from underrepresented groups
FALL 2005
ATEAM

10. Outcomes Based Evaluation
Step Two:
Identify the desired outcomes
FALL 2005
ATEAM

11. Outcomes Based Evaluation
Using the case study in activity two, what are the outcomes?
increased enrollment;
increased number of qualified professionals;
the creation of products or services.
FALL 2005
ATEAM

12. Outcomes Based Evaluation
Step Three:
Determine how you will measure
FALL 2005
ATEAM

13. Outcomes Based Evaluation
Using the case study in activity two, what are the measures?
20 students from underrepresented groups:
FALL 2005
ATEAM

14. Outcomes Based Evaluation
Step Four:
Determine data source
FALL 2005
ATEAM

15. Outcomes Based Evaluation
Using the case study in activity two, what is the potential data source?
enrollment figures
FALL 2005
ATEAM

16. Outcomes Based Evaluation
Step Five:
Determine data collection interval
FALL 2005
ATEAM

17. Outcomes Based Evaluation
Using the case study in activity two, when will data be collected?
potentially when enrollment closes
FALL 2005
ATEAM

18. Outcomes Based Evaluation
Using the case study in activity two, an outcomes based evaluation statement might read as follows:
Outcome:
New students will enroll in MLIS programs as a result of providing educational stipends.
Indicator:
Number and percent of new WSU Library and Information Science Program enrollees who indicate that the program significantly contributed to their decision to enroll in the LIS program;
FALL 2005
ATEAM

19. Outcomes Based Evaluation
After the evaluation results have been collected, the information gathered by the evaluation process should be compiled into a formal report. Essentially, it needs to state:
What did we want to do?
Did we do it?
What impact did it have?
The report is a strong basis for communicating the value of the program to internal management decision-makers and to external groups.
FALL 2005
ATEAM

20. Outcomes Based Evaluation
Reminder:
Outcome-based Evaluation is a systematic way to assess the extent to which a program has achieved its intended results.
FALL 2005
ATEAM