1. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie ANNIES Impact Reporting: Stepping Up to the Challenge National Women in Agriculture Educators Conference March 25, 2010 in Baltimore, MD Madeline Schultz and Bob Wells

2. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Annie’s Project Mission To empower farm women to be better business partners through networks and by managing and organizing critical information.

3. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Purposes of Evaluation “An evaluation approach should be rigorous in its efforts to determine the worth of a program and to guide program implementation and management, as well as relevant and useful to program practitioners.” Anne C. Peterson Senior Vice President for Programs, W.K. Kellogg Foundation

4. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Layers of ANNIES Evaluation Outcomes: 1. Knowledge 2. Actions 3. Impacts Demographics: 1. Numbers 2. Characteristics

5. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Importance of Impacts Reports and requests –Universities & organizations –Government & private funders Impacts demonstrate true success –Profitability –Rural lifestyle satisfaction ANNIES Learning & growth

6. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie ANNIES has Meaningful Data Class Evaluations –Local, state and national reports Journal of Extension –The Effectiveness of Women’s Agricultural Education Programs: A Survey from Annie’s Project ANNIES Fall 2009 Survey 2009 NIFA portfolio review

7. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie 21 Annie’s Project States Demographics Measures

8. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie StateCY 2009Jan-Mar 2010 No. Level I Classes Number of Participants No. Level I Classes Number of Participants Arkansas0000 Delaware00235 Florida00567 Illinois14159324 Indiana87300 Iowa5101339 Kansas11500 Kentucky8159465 Maryland124773 Michigan2337148 Minnesota230335 Demographics Measures

9. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie StateCY 2009Jan-Mar 2010 No. Level I Classes Number of Participants No. Level I Classes Number of Participants Mississippi0000 Missouri778569 Montana00969 Nebraska112230 North Dakota14150777 Ohio120574 Oklahoma21600 Pennsylvania0000 South Dakota223128 Wisconsin351357 Totals7194466890 Demographics Measures

10. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Demographics Age Average: 49 Range: 29-57 Marital Status 11 (All) Married Children Average: 2 Range: 1-5 Counties McLeod -4 Wright - 4 Sibley - 3 Wright, Pope – 1 Wright, Pope, Stearar – 1 Business Information Years Farming Average: 18 Range: 2-33 Total: 217 Acres Total Owned: 5646 Average Owned: 471 Total Farmed*: 10,940 Average Farmed*:2817 Type of Business Organization 9 Sole Owners 2 Partnerships Incomes $50,001-$150,000: 6 $15,001-$300,000: 2 Over $300,000: 2 Sample Pre-Class Survey Analysis Demographics Measures

11. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Journal of Extension Article Table 1: Summary of 'Yes' Responses for Selected Questions QuestionPre-test Percent Yes Post-test Percent Yes Difference Production records70.00%83.70%13.70% Marketing plan10.00%22.80%12.80% Balance Sheet55.80%77.20%21.40% Income Statement43.20%68.50%25.30% Comfort w/debt level66.30%84.80%18.50% Next generation plan45.30%64.10%18.80% Life Insurance90.50%95.70%5.20% Will70.00%76.10%6.10% Source: Hambleton-Heins Southern Illinois University, 2009 Outcome Measures of Knowledge

12. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Source: Hambleton-Heins Southern Illinois University, 2009 Table 2: Pre-test/Post-test Comparison by Risk Category and by Total Risk Category # of questions Pre-test % yes Post-test % yesDifference % Change Production1247.63%52.81%5.18%10.80% Marketing626.58%35.33%8.75%32.90% Financial1556.74%72.32%15.58%27.40% Legal650.96%64.67%13.71%26.90% Human Resource1049.21%59.67%10.46%21.20% All Categories4948.57%59.49%10.92%22.50% Journal of Extension Article Outcome Measures of Knowledge

13. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie ANNIES Fall 2009 Survey 61% of respondents –developed a network of local peers and professionals –that motivate and support them with risk management issues Outcome Measures of Actions

14. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Percent of Participants Attending Additional Educational Classes Outcome Measures of Actions

15. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Responses to the Question: What was the most important thing you took away from Annie’s Project? “I did feel better informed; "empowered" to ask questions and apply research; and overall encouraged to use the skills given in the class as well as from other farm wives.” “I now know who I need to go talk to when I have a question on any farming topic. Annie's Project brought in a great group of speakers who know the industry well and are very helpful even after the classes.” “The support of other women, going thru the same challenges...it changed my life forever, knowing I have valuable skills inside me that are now emerging...to learn, grow and share with other people. Outcome Measures of Actions

16. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie 2009 NIFA Portfolio Review –NIFA demonstrated ANNIES relevance to Risk management education FSA borrower training NRCS collaborations National network of educators working together Intersection of farm and family finances –Reported in NIFA Sustainable Agriculture Primary KA 902 and Secondary KAs 607, 801 Outcome Measures of Action

17. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Testimonials Stories of improved conditions resulting from new knowledge and the actions women take after participating in Annie’s classes Qualitative data is useful, but we still need quantitative measures Outcome Measures of Impacts http://www.extension.iastate.edu/annie/testimonials.html

18. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Stepping up to the Challenge ANNIES would like to re-survey more participants to collect impacts over time –Qualitative stories –Quantitative measures ANNIES would like to implement –Collection of more complete and relevant data –Third party objectivity through an evaluation partner –Greater accuracy in analysis and reporting –Attention to creation of scholarly work

19. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Integrate Evaluation with Planning Logic models Evaluation teams Stakeholders Good questions Eval. processes Budgets Analysis and Reporting

20. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie NIFA Logic Model

21. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Evaluation Teams ANNIES has good evaluation resources Access to third party evaluator –Adds credibility –ISU Research Institute for Studies in Agriculture Creates opportunity to build evaluation capacity

22. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Good Questions ANNIES is working to –Develop new evaluation instruments –Pilot these in IA & IL We want input from the network The goal is national consistency

23. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Good Program Evaluation Benefits ANNIES and Women in Agriculture Gain new knowledge about women in agriculture and their learning needs Strengthen effectiveness of courses Create new courses to meet identified needs Support further educator network development and organization Build shared meaning and understanding about ANNIES with other organizations Expand ANNIES to serve more women in more ways

24. Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension www.extension.iastate.edu/annie Thank You for Your Interest! Madeline Schultz Iowa State University Extension Program Coordinator 515-294-0588 shultz@iastate.edu Bob Wells Iowa State University Extension Farm Management Specialist 641-673-5841 wellsjb@iastate.edu