1. The Lumina Center Grantseeking Workshop Series Presents Outcomes & Evaluations April 20, 2006

2. Project components Defining outcomes Outcomes based planning Outcomes vs. outputs Identifying your audience Setting outcomes to drive planning Making outcomes measurable

3. Inputs Inputs (Money, staff, volunteers, facilities, equipment, supplies) Activities Activities (Strategies, techniques, types of treatment) Outputs Outputs (direct products, classes taught, educational materials distributed)

4. Inputs Inputs Activities Activities Outputs Outputs Outcomes Outcomes (including indicators and data sources)

5. The “So What” factor As funding becomes more scarce, service providers, governments, other funders, and the public are calling for clearer evidence that the resources they expend actually produce benefits for people. Funders want greater accountability for the use of their resources.

6. Outcomes are the BENEFITS realized as a result of the project. Outcomes are the BENEFITS realized as a result of the project. They represent the IMPACT of the project on its participants. They represent the IMPACT of the project on its participants. They typically represent a CHANGE in the behavior, attitude, skills, status, knowledge, or life condition of the project participants. They typically represent a CHANGE in the behavior, attitude, skills, status, knowledge, or life condition of the project participants.

7. Outcome based planning uses audience needs and hoped-for results as the foundation for programs and design decisions

8. Outcome based evaluation is a systematic way to assess the extent to which a program has achieved its intended results. It focuses on the key questions “How has my program made a difference?” “How has my program made a difference?” “How are the lives of the program participants better as a result of my program?” “How are the lives of the program participants better as a result of my program?”

9. Provides a logical framework for program development Provides a logical framework for program development Increases program effectiveness Increases program effectiveness Communicates program value Communicates program value Generates information for decision-making Generates information for decision-making

10. Not identical to formal research Not identical to formal research Suggest cause and effect, it doesn’t intend to prove it Suggest cause and effect, it doesn’t intend to prove it Shows contribution, not attribution Shows contribution, not attribution

11. Are the outcomes related to the “core business” of your program? Are the outcomes related to the “core business” of your program? Is it within your control to influence the outcomes? Is it within your control to influence the outcomes? Are your outcomes realistic and attainable? Are your outcomes realistic and attainable? Are your outcomes achievable within the funding and reporting periods? Are your outcomes achievable within the funding and reporting periods?

12. Are your outcomes written as change statements—will things increase, decrease, or stay the same? Are your outcomes written as change statements—will things increase, decrease, or stay the same? Have you moved beyond client satisfaction in your outcomes? Have you moved beyond client satisfaction in your outcomes? Is there a logical sequence among your short-term, intermediate, and long-term outcomes? Is there a logical sequence among your short-term, intermediate, and long-term outcomes? Are there any big “leaps” in your outcomes (i.e. gaps in the progression of impacts)? Are there any big “leaps” in your outcomes (i.e. gaps in the progression of impacts)?

13. Activities and services leading towards intended outcomes Activities and services leading towards intended outcomes Have a definite beginning and end Have a definite beginning and end Design it to change attitudes, behaviors, knowledge, or increase skills and abilities based on assumed need Design it to change attitudes, behaviors, knowledge, or increase skills and abilities based on assumed need

14. Programs are developed as a result of assumptions about people’s needs Information can be drawn from: Your experiences Your experiences A program partner’s experiences A program partner’s experiences Formal or informal research Formal or informal research

15. NEED: A condition, want, deficit that is common to a group of individuals SOLUTION: A program that will change or improve behaviors, knowledge, skills, attitudes, life condition, or status DESIRED RESULTS: The change or improvement you expect to achieve

16. NEEDSSOLUTIONSRESULTS Getting to evaluation of outcomes: What are the indicators? What are the data sources?

17. OutcomeIndicator Data Source Students know key principles of archival selection The # and % of students who can list and define at least 5 valid selection criteria Course assignment Students can apply basic concepts of archival arrangement The # and % of students who can correctly arrange a folder of 15 unsorted documents according to provenance and original order Course assignment Students can create basic archival records The # and % of students who can generate a basic USMARC record for 3 test documents End of course exam

18. Based on audience success Based on audience success That they know something or will be able to do something That they know something or will be able to do something They can be measured at various times (i.e. Initial, Intermediate, Long Term) They can be measured at various times (i.e. Initial, Intermediate, Long Term) Targets can be established for each period Targets can be established for each period

19. Reports summarize the results of outcome data and include: Participant characteristics Participant characteristics Inputs, activities & services, outputs and outcomes Inputs, activities & services, outputs and outcomes Elements requested by funders Elements requested by funders Comparisons of previous periods Comparisons of previous periods Interpretation of data Interpretation of data

20. After a reasonable period of operation, evaluate the effectiveness of the outcomes system: Have audiences been sufficiently identified? Have audiences been sufficiently identified? Are outcomes clearly written? Are outcomes clearly written? Are outcomes sufficient to describe what you hope will happen? Are outcomes sufficient to describe what you hope will happen? Are data collection methods cost efficient? Are data collection methods cost efficient?

21. September 21, 2006: “Introduction to Grantseeking on Campus” (repeat) October 19, 2006: “Federal Grantseeking” November 16, 2006: “Collecting Data for Grantseeking”

22. Questions and Comments