1. Meta-evaluation

2. Review What are these checkpoints? How to put your result together?
What are lessons-learned during the exercise?
S519

3. Meta-evaluation
It is evaluation of an evaluation (Scriven, 1991) to determin the quality and/or value of an evaluation
S519

4. Five criteria
Validity
Utility
Conduct
Credibility
Costs
S519

5. Validity
To what extent, the conclusions of the evaluation are justified
Check carefully the facts they use and values they assign
Question everything
Constraints (budget, time, etc.)
Using KEC checkpoints
Using standards (
S519

6. Validity Covers all relevant sources of value
Comprehensively covers process, outcome and cost
Include no irrelevant or illicit criteria
Data used to directly address the criteria
Include analyses that are appropriate for the data
Clearly states how data are interpreted
Is clear about where evaluative conclusions come from
Include valid recommendation
S519

7. Utility Are the findings
Relevant to the questions or decisions being faced by the audience
Timely
Clearly communicated
Cost effective
S519

8. Conduct Legal Ethical Professional standards Cultrual appropriateness
Unobtrusiveness
Minimal disruptive to the evaluand
S519

9. Credibility Familiar with the context
Independence, impartiality, and/or lack of conflict of interest
Expertise in evaluation and in the evaluation subject field
S519

10. Cost
How reasonable the costs of an evaluation
S519

11. Meta-evaluation rating table
S519