Program Evaluation Presenter: Dr. Laura R. Dawson Executive Vice President/COO The Dawson Group of Virginia, Inc.

Introduction Introduction “Perhaps the most striking finding in undergraduate education is the lack of rigorous evaluation of federal investments due to inadequate mechanisms for the collection of data on long-term student outcomes.” U.S. Department of Education, Report of the Academic Competitiveness Council, Washington, DC, 2007 “Results not demonstrated” General Accounting Office (GAO) Report Finding on Title III Program 2

Evaluation is Not an Option, It’s a REQUIREMENT A good Title III Program Evaluation Plan…  Provides for multi-faceted and continuous evaluation that is implemented during all phases and all years of the grant.  Is designed around the specific objectives and performance indicators listed in the approved 5-year Title III Comprehensive Development Plan (CDP), as well as those listed in the annually approved grant applications submitted within the 5-year funding cycle. 3

Preparing a Title III Program Evaluation Plan A good Title III Program Evaluation Plan…  Assesses projected outcomes and anticipated results listed in the plan of operation. (Outcomes Assessment)  Assesses effectiveness of processes/methodologies used to achieve outcomes. (Process Assessment)  Tells who will be responsible for each aspect of implementing the evaluation plan.  Discusses fiscal accountability. 4

Preparing a Title III Program Evaluation Plan A good Title III Program Evaluation Plan…  Describes what data and other information will be gathered.  Describes how the data will be gathered (i.e., instrumentation, observation, etc.).  Discusses procedures/methods used for data analysis and reporting. 5

Preparing a Title III Program Evaluation Plan A good Title III Program Evaluation Plan…  Describes the purpose(s), processes, timetable and reporting of the evaluation.  Tells who will get copies of the evaluation report.  Tells how the evaluation findings will be used.  Includes monitoring assessments.  Is ongoing, provides structure, accountability, documentation, and follow-up. 6

Preparing a Title III Program Evaluation Plan A good Title III Program Evaluation…  Includes formative and summative assessments.  Includes impact assessments and discussion of impact findings.  Addresses the adequacy of funding from all sources.  Addresses the major problems encountered and how they were resolved.  Includes recommendations, as appropriate. 7

Title III Program Evaluation Plan Worksheet Data Collection Person(s) Responsible Completion Date Report of Findings (Completion Date) Specific Data to be Collected and How Data Analysis Procedures Evaluation Report Completed ( / / ) Contents of Evaluation Report Distribution Use of Evaluation Findings/Follow-up Grant Title________________________________ Activity Title___________________ FY____ Objective #___: ___________________________________________________________________ _________________________________________________________________________________ Anticipated Results: ( )____________________________________________________________ ( )____________________________________________________________