1. University of Colorado at Boulder CRA/NSF Broadening Participation Workshop October 20-21, 2004 Evaluation’s Role in Broadening Participation in TeraGrid Lecia Barker University of Colorado at Boulder

2. CRA/NSF Broadening Participation Workshop October 20-21, 2004 It’s not about accountability.

3. University of Colorado at Boulder CRA/NSF Broadening Participation Workshop October 20-21, 2004 Why include evaluation? Improve progress toward goals –“formative” Identify not just what works, but how –What happened? –How do you know? –How might outcomes vary in different settings?

4. University of Colorado at Boulder CRA/NSF Broadening Participation Workshop October 20-21, 2004 Why include evaluation? What is the value added? Is it sustainable? –Under what circumstances? Is it scalable? –Can people easily adopt/integrate into existing practices? –How do you persuade people to adopt? –How did setting affect outcomes?

5. University of Colorado at Boulder CRA/NSF Broadening Participation Workshop October 20-21, 2004 What will an evaluator do? Ask relevant questions Develop a plan based on your goals and activities Use rigorous social scientific methods –Collect more than one type of data –Repeat measures Analyze, report back

6. University of Colorado at Boulder CRA/NSF Broadening Participation Workshop October 20-21, 2004 How to integrate evaluation Evaluation is a team function Involve evaluation from the outset Include adequate funding in budget to show that evaluation is being taken seriously Read, discuss evaluation reports Be willing to make change

7. University of Colorado at Boulder CRA/NSF Broadening Participation Workshop October 20-21, 2004 Where to find evaluation resources Social science departments, including education American Evaluation Association –www.eval.org Evaluation Checklist Project –www.wmich.edu/evalctr/checklists User-Friendly Handbooks by NSF –www.ehr.nsf.gov/rec/programs/evaluation/handbook/ –www.ehr.nsf.gov/EHR/REC/pubs/NSF97-153/START.HTM Online Evaluation Resource Library –http://www.ehr.nsf.gov/EHR/REC/pubs/NSF97-153/START.HTM