What is Evaluation Research?

Evaluation is…. A way of viewing the project, its participants, it effect Measurements are the currency

Defining Evaluation Research Evaluation is a methodological area that is closely related to, but distinguishable from more traditional social research. Evaluation utilizes many of the same methodologies used in traditional social research, but because evaluation takes place within a political and organizational context, it requires group skills, management ability, political dexterity, sensitivity to multiple stakeholders and other skills that social research in general does not rely on as much. - Trochim

Defining Evaluation Research Evaluation is the systematic assessment of the worth or merit of some object This definition is hardly perfect. There are many types of evaluations that do not necessarily result in an assessment of worth or merit -- descriptive studies, implementation analyses, and formative evaluations, to name a few. Better perhaps is a definition that emphasizes the information-processing and feedback functions of evaluation. For instance, one might say: Evaluation is the systematic acquisition and assessment of information to provide useful feedback about some object - Trochim

A second look….. 1.Systematically define what data will be collected, how, when & by whom 2.Process the data to determine what it means within specified contexts 3.Tell constituents about findings in appealing & appropriate ways 4.Disseminate broader findings to share within disciplines

Evaluative Thinking Reflective practice of systematically using data to inform decisions It’s an ongoing process Approach to making decisions, what actions to take, to become/remain effective at the organizational (or individual) goals IT’S LEARNING, and APPLYING LEARNING Questions about the value or worth of something Context of how value is measured The data measured The knowledge from the measured data Informed Decisions & Actions (based upon value judgment)

The Process: STARS Overall Questions about the value or worth of something Context of how value is measured The data measured The knowledge from the measured data Informed Decisions & Actions How is STARS making a difference? Corps Students CS Faculty CS Depts. K12 outreach participants Multiple perspectives from: Corps Students CS Faculty CS Depts. K12 outreach participants EA projects External evaluator input National comparisons How is STARS making a difference? Corps Students & Faculty say collectively + individual stories Exemplars Modifications How, what, when, who measures? Corps Students Surveys & interviews CS Faculty Surveys & focus groups CS Depts. Chair interviews K12 outreach participants EA projects Revise, Reform & Disseminate