WRITING EFFECTIVE GRANT PROPOSALS With an Eye toward Performance and Evaluation Issues

What I will do today Give a historical perspective on outcomes Give a historical perspective on outcomes Review different models of outcome measurement and define basic concepts common to them Review different models of outcome measurement and define basic concepts common to them Explain how outcome measurement and logic models fit into grant proposals Explain how outcome measurement and logic models fit into grant proposals Provide tips for preparing performance- based proposals Provide tips for preparing performance- based proposals

A Century of Changing Expectations 100 years ago: “Doing Good” 100 years ago: “Doing Good” Does your organization have a charitable purpose? Does your organization have a charitable purpose? Depression Era: Fiscal Accountability Depression Era: Fiscal Accountability How did you use the money? How did you use the money? After WWII: Efficiency After WWII: Efficiency How much did you produce with the money? How much did you produce with the money? 1980’s Onward: Outcomes 1980’s Onward: Outcomes What difference did you make with the money? What difference did you make with the money?

FORCES FOR CHANGE Government Performance and Results Act Government Performance and Results Act National Performance Review National Performance Review Service Efforts and Accomplishments Reporting Service Efforts and Accomplishments Reporting Total Quality Management Total Quality Management Managed Care Managed Care

What are Outcomes? Outcome – A positive change in the Outcome – A positive change in the Behavior Behavior Attitudes or beliefs Attitudes or beliefs Condition or Status Condition or Status Knowledge, or Knowledge, or Skills Skills of the person, organization, or environment the program exists to serve!

A Sampling of OM models Logic Model (United Way of America/Urban Institute) Logic Model (United Way of America/Urban Institute) Outcome Funding Framework (Rensselaerville Institute) Outcome Funding Framework (Rensselaerville Institute) Benchmarking for Nonprofits (Saul) Benchmarking for Nonprofits (Saul) Balanced Scorecard/Nonprofit Dashboard (Harvard Business School) Balanced Scorecard/Nonprofit Dashboard (Harvard Business School) Getting to Outcomes (CSAP) Getting to Outcomes (CSAP) Results Based Accountability (Fiscal Policy Studies) Results Based Accountability (Fiscal Policy Studies) Targeting Outcomes of Programs (Bennett & Rockwell) Targeting Outcomes of Programs (Bennett & Rockwell)

What They Want To Know InputsActivities Outcomes Outputs Outcome Indicators Output Targets Outcome Targets Infrastructure or Process Measures Process Targets

Key Questions To Answer Why do you think you should do this? Why do you think you should do this? Why do you think you can do this? Why do you think you can do this? What do you plan to do, how much, and by when? What do you plan to do, how much, and by when? What difference will your efforts make, and by when? What difference will your efforts make, and by when? For all of these questions: For all of these questions: What evidence can you produce? What evidence can you produce? Where do you get the evidence? Who will collect it, how and by when? Where do you get the evidence? Who will collect it, how and by when?

Look beyond TERMS to CONCEPTS What resources are devoted to the problem - INPUTS What resources are devoted to the problem - INPUTS What the org. does to advance its mission - ACTIVITIES What the org. does to advance its mission - ACTIVITIES How much the org. does/how many it serves - OUTPUTS How much the org. does/how many it serves - OUTPUTS What changes are brought about (knowledge, skills, attitude, beliefs, behavior) in the participants – OUTCOMES What changes are brought about (knowledge, skills, attitude, beliefs, behavior) in the participants – OUTCOMES What longer-term effects may occur because of the achievement of outcomes – IMPACTS What longer-term effects may occur because of the achievement of outcomes – IMPACTS What quantifiable evidence exists to demonstrate that the outcome has occurred – OUTCOME INDICATORS What quantifiable evidence exists to demonstrate that the outcome has occurred – OUTCOME INDICATORS

The Extended Logic Model InputsActivities Primary Outcomes Intermediate Outcomes Long-term Outcomes Outputs Indicators Output Targets Indicators Targets Indicators Targets Infrastructure or Process Measures Process Targets

Data Collection Methods Participants can tell you Participants can tell you Other people can tell you Other people can tell you Participants can show you Participants can show you You can weigh or measure You can weigh or measure You can check internal or external records You can check internal or external records

COMPARISON OF MAJOR DATA COLLECTION METHODS Review of Program Records Self-Admin Survey InterviewRating by Trained Observer CostLowModerateModerate to high Depends Data Collector Training Required SomeNone to some Moderate to high Completion time ShortModerate to long LongShort to moderate Response rate HighDependsModerate to good High

Performance Based Proposals Advance the funder’s agenda Advance the funder’s agenda Meet a compelling and demonstrated need Meet a compelling and demonstrated need Are focused on outcomes, but don’t neglect process or infrastructure Are focused on outcomes, but don’t neglect process or infrastructure Propose best practice and/or innovative activities likely to produce outcomes Propose best practice and/or innovative activities likely to produce outcomes Have clear and logical indicators and reasonable targets Have clear and logical indicators and reasonable targets Have practical and defined methods to gather evidence Have practical and defined methods to gather evidence

Evaluation Considerations Whenever possible without sacrificing quality or appropriateness, Pick the minimum number of indicators and outputs for each outcome or activity – one or two is best Pick the minimum number of indicators and outputs for each outcome or activity – one or two is best Pick indicators that are easy to measure and record Pick indicators that are easy to measure and record Pick indicators that can be measured at low cost. Pick indicators that can be measured at low cost. Pick the lowest reasonable targets Pick the lowest reasonable targets Measure a sampling of participants Measure a sampling of participants Use internal agency data over external Use internal agency data over external Avoid situations requiring consent forms or IRB review Avoid situations requiring consent forms or IRB review

Performance Based Proposals Are more about funders and beneficiaries than agencies Are more about funders and beneficiaries than agencies March in formation: March in formation: Needs and Inputs Needs and Inputs Activities/Programs/Processes Activities/Programs/Processes Outcomes Outcomes Targets Targets Evaluation methods Evaluation methods

Thank You for Coming! WRITINGEFFECTIVEGRANTPROPOSALS ©Lori Fabian Fabian Consulting, Inc. May 2007