8 th Annual Performance Report Scorecard by Maurice McTigue, Henry Wray, and Jerry Ellig A GENDA Welcome Hon. Maurice McTigue Study Results Dr. Jerry Ellig Remarks Hon. David Walker Q&AHon. Maurice McTigue AwardsHon. Maurice McTigue Hon. David Walker
Smith pioneered performance reporting “He also made a Table, as a publicke memorial of every mans deserts, to incourage the good, and with shame to spurre on the rest to amendment. By this many became industrious, yet more by punishment performed their businesse, for all were so tasked, that there was no excuse could prevaile to deceive him…” The Complete Works of Captain John Smith, Vol. II, p. 208.
Sophisticated Performance/Accountability OutcomeSurvival Outcome-oriented performance measure How many survived? Logic modelIf we don’t gather food, we starve. Control for external factors“…of 200 (except they were drowned) there died not past seven…” Linkage to costs“He that will not worke shall not eate…”
Pocahontas rescues Capt. Smith during accountability ceremony, 1608
How we score the reports 1-5 rating scale 3 Categories Transparency Public Benefits Leadership 4 criteria in each category 5Sets a standard for best practice 4Shows innovation and creativity 3Satisfactory 2Partially complete 1Fails to meet expectations
A caveat … This Scorecard evaluates only the quality of agency reports, not the quality of the results they produced for the public. Actual agency performance may or may not be correlated with report rankings in this Scorecard. This Scorecard evaluates only the quality of agency reports, not the quality of the results they produced for the public. Actual agency performance may or may not be correlated with report rankings in this Scorecard.
3 Points Separate Top 4 FY 2006 Score FY 2006 Rank FY 2005 Score FY 2005 Rank Transportation Labor512 1 Veterans State504482
Substantial churn below top 4 GSA (+11), Education (+9), EPA (+5) Improvement near the bottom: Social Security (+6), Defense (+5), NASA (+4) SBA (-11), Treasury (-6), HUD (-6), OPM (-6), Interior (-5), Energy (-4)
Dollar-weighted scores improved
13% of budget covered by satisfactory disclosure
Individual criteria Most improved criteria Accessibility (#1) Linkage of results to costs (#8) Many caught up with prior best practice! Most deteriorated criterion: Does report show how the agency makes the country a better place to live? (#9) New best practice!
Biggest challenges Average score Link results with costs Outcome-oriented measures Ensure data quality Demonstrate causality Explain failures to achieve goals Major management challenges
Scorecard vs. PART 78% of spending covered by reports scoring below 8 on Public Benefits 5.5% of PARTed spending is “results not demonstrated”
Overall state of accountability
Why Good Reporting Matters Today
For more information Mercatus Scorecard web page: Note: Scoring guidance for fiscal 2007 is written into the “Strongest and Weakest” Section of the fiscal 2006 Scorecard.