1. 9/16/2018
The ACT Government’s commitment to Performance and Accountability – the role of Evaluation
Presentation to the Canberra Evaluation Forum
Thursday, 21 April 2011.
9:00 am.
Pam Davoren
DEPUTY CHIEF EXECUTIVE, POLICY
ACT Chief Minister’s Department

2. Today’s Presentation Background
9/16/2018
Today’s Presentation
Background
Overview of the ACT Government’s Performance and Accountability Framework and Evaluation Policy and Guidelines
Assessing and developing evaluation maturity across ACT Government
Implementation challenges

3. 9/16/2018
Background
The ACT Government agreed to an ongoing program of work, Accountability in Government, in This aimed to:
strengthen the Government’s capacity to deliver policies and service delivery outcomes;
promote agency accountability and performance; and
develop an updated performance and accountability framework for implementation across Government.

4. Where are we coming from...
9/16/2018
Where are we coming from...
A set of mechanisms to help:
achieve agreed objectives
drive better performance
ensure accountability for decision-making
This includes:
legislation
plans
performance agreements
reports
review mechanisms

5. Why update the ACT Framework?
9/16/2018
Why update the ACT Framework?
Review findings – a range of opportunities for improvement
External requirements - performance and reporting
Benefits - government, agencies, community

6. The process Budget Initiative
9/16/2018
The process
2008
Budget Initiative
2009
Report by the Allen Consulting Group (ACG)
Further agency consultation
2010
ACG Options and Analysis Report
Draft ACT Framework Paper
2011
Onwards – Implementation

7. The ACT Government Framework
9/16/2018
The ACT Government Framework
16/09/2018

8. Opportunities to improve...
9/16/2018
Opportunities to improve...
Clarity and focus of Government priorities
Integration of Government and agency planning, and resource allocation
Usefulness of performance indicators
Performance capacity
Delivery of shared priorities
Accessibility and usefulness of reporting
Evaluation practices

9. 9/16/2018
Planning
16/09/2018

10. 9/16/2018
Managing

11. 9/16/2018
Reporting

12. Measuring our Progress Website
9/16/2018
Measuring our Progress Website
16/09/2018

13. 9/16/2018
Reviewing

14. ACT Evaluation Policy and Guidelines
9/16/2018
ACT Evaluation Policy and Guidelines
The Evaluation Policy aims to:
improve the efficiency, effectiveness and appropriateness of government services;
and build evaluation maturity across government.
The Evaluation Policy document defines evaluation, outlines the objectives and benefits of evaluation, outlines steps for development evaluation maturity and provides a step by step guide to evaluation.

15. 9/16/2018
Evaluation Policy
The Evaluation Policy encourages a strategic rather than process-driven approach to evaluation.
The Evaluation Policy requires all agencies to:
Prepare an annual evaluation plan; and
Align evaluation with the funding cycle.

16. Developing Evaluation Maturity
9/16/2018
Developing Evaluation Maturity
Element
Maturity level
Beginning
Developing
Embedded
Leading
Culture
Evaluation awareness is low and is as a response to identified problems.
Widespread awareness of the benefits of evaluation.
Evaluation perceived as an integral component of sound performance management.
Demonstrated commitment to continuous learning and improvement throughout agency.
Capacity
Evaluation skills are limited.
No formal evaluation procedures and structures are in place.
Targeted training and recruitment is used to develop staff skills.
Formal evaluation policies and structures are in place.
General evaluation skills are widespread.
Relevant staff have higher order skills and experience, which is leveraged by the agency.
Evaluation systems, structures and procedures are robust, integrated and of proven effectiveness.
The agency is recognised for its evaluation expertise and innovative procedures and systems.
Planning
Evaluation planning occurs for some programs/policies, mainly after implementation.
No, or very basic, Agency Evaluation Plan.
Policies/programs have well defined objectives and performance indicators as a baseline for future evaluation.
Evaluation activity is coordinated and an Evaluation Plan is in place.
Evaluation planning is an integral component of policy development.
Evaluation plans are in place for most policies and programs.
Strategy
Programs with identified problems are prioritised.
Large and risky programs are prioritised.
Guidelines for prioritising and scaling evaluation activity are used.
Sophisticated risk index and guidance material are used to prioritise and scale evaluation.
Conducting
Evaluation occurs but infrequent and ad hoc.
Priority programs are evaluated.
Evaluation of policies is widespread and conforms to agency quality standards.
Evaluation almost universal and conforms to recognised standards of quality.
Using
Evaluation findings disseminated within agency.
Significant recommendations implemented.
Evaluation findings routinely inform decision making and are often disseminated outside agency.
Evaluation findings are widely disseminated, and used to drive better performance.
Findings are used to optimise service delivery and have influence outside the agency.

17. Evaluation Guidelines
9/16/2018
Evaluation Guidelines
The guidelines assist agencies in developing evaluation maturity by:
fostering a culture of evaluation;
building evaluation capability;
planning to evaluate;
evaluating strategically;
conducting high standard evaluations; and
making evaluation count.

18. Scaling Evaluation Activity
9/16/2018
Scaling Evaluation Activity
Scaling of evaluation
Characteristics of policy or program
Low risk
Limited resource requirements
Similar to previous successful and favourably reviewed projects
Not widely publicised
Low strategic priority
New and untried project
Not recently reviewed
Requires resources for testing, research and external stakeholder involvement
High risk
Resource intensive
Controversial project
High public profile and expectations
Politically significant
Likely characteristics of evaluation
Informal process
Limited data requirement, analysis of issues and reporting
Low resource allocation
Less evaluations required of fewer aspects of policy or program
Can be completed internally
Greater level of data collection and analysis
Frequent throughout development and implementation
Regular progress reporting
Can be undertaken by practitioners during development and implementation
Formal process
Detailed
High resource allocation
Comprehensive reporting and wide public release and involvement
May involve external evaluators or central agencies

19. Key Features of the Document
9/16/2018
Key Features of the Document
The Evaluation Policy document is flexible, adaptable to support whole-of-government implementation.
Highlights the challenges of evaluation, including:
the distinction between program and policy evaluation;
limited resources for evaluation;
differing levels of reporting and evaluation requirements across agencies; and
differing levels of evaluation maturity across agencies.

20. 9/16/2018
The Hawke Review
A review of the ACT Public Service initiated by the Chief Minister in 2010
Dr Allan Hawke AC was asked to review the effectiveness, capacity and structures of the ACT Public Service
The report Governing the City State was presented to Government in early 2011.

21. Implementation Challenges
9/16/2018
Implementation Challenges
There is a significant body of reform related to these Frameworks. The associated implementation challenges, include:
limited resources;
co-ordination of effort;
external factors;
perceptions of evaluation;
maintaining momentum; and
phasing implementation and coordinating with other reforms.

22. 9/16/2018
Discussion