1. 8 th Annual Performance Report Scorecard by Maurice McTigue, Henry Wray, and Jerry Ellig A GENDA Welcome Hon. Maurice McTigue Study Results Dr. Jerry Ellig Remarks Hon. David Walker Q&AHon. Maurice McTigue AwardsHon. Maurice McTigue Hon. David Walker

2. Smith pioneered performance reporting “He also made a Table, as a publicke memorial of every mans deserts, to incourage the good, and with shame to spurre on the rest to amendment. By this many became industrious, yet more by punishment performed their businesse, for all were so tasked, that there was no excuse could prevaile to deceive him…” The Complete Works of Captain John Smith, Vol. II, p. 208.

3. Sophisticated Performance/Accountability OutcomeSurvival Outcome-oriented performance measure How many survived? Logic modelIf we don’t gather food, we starve. Control for external factors“…of 200 (except they were drowned) there died not past seven…” Linkage to costs“He that will not worke shall not eate…”

4. Pocahontas rescues Capt. Smith during accountability ceremony, 1608

5. How we score the reports 1-5 rating scale 3 Categories Transparency Public Benefits Leadership 4 criteria in each category 5Sets a standard for best practice 4Shows innovation and creativity 3Satisfactory 2Partially complete 1Fails to meet expectations

6. A caveat … This Scorecard evaluates only the quality of agency reports, not the quality of the results they produced for the public. Actual agency performance may or may not be correlated with report rankings in this Scorecard. This Scorecard evaluates only the quality of agency reports, not the quality of the results they produced for the public. Actual agency performance may or may not be correlated with report rankings in this Scorecard.

7. 3 Points Separate Top 4 FY 2006 Score FY 2006 Rank FY 2005 Score FY 2005 Rank Transportation531473 Labor512 1 Veterans512464 State504482

8. Substantial churn below top 4 GSA (+11), Education (+9), EPA (+5) Improvement near the bottom: Social Security (+6), Defense (+5), NASA (+4) SBA (-11), Treasury (-6), HUD (-6), OPM (-6), Interior (-5), Energy (-4)

9. Dollar-weighted scores improved

10. 13% of budget covered by satisfactory disclosure

11. Individual criteria Most improved criteria  Accessibility (#1)  Linkage of results to costs (#8) Many caught up with prior best practice! Most deteriorated criterion:  Does report show how the agency makes the country a better place to live? (#9) New best practice!

12. Biggest challenges Average score 2006 2005 8. Link results with costs 2.29 1.88 6. Outcome-oriented measures 2.67 2.63 3. Ensure data quality 2.67 2.67 7. Demonstrate causality 2.75 2.79 10. Explain failures to achieve goals 2.79 2.75 11. Major management challenges 2.79 2.83

13. Scorecard vs. PART 78% of spending covered by reports scoring below 8 on Public Benefits 5.5% of PARTed spending is “results not demonstrated”

14. Overall state of accountability

15. Why Good Reporting Matters Today

16. For more information Mercatus Scorecard web page: www.mercatus.org/scorecard Note: Scoring guidance for fiscal 2007 is written into the “Strongest and Weakest” Section of the fiscal 2006 Scorecard.