Indicators to measure the effectiveness of the implementation of the Strategy State of the art Karin Sollart Netherlands Environmental Assessment Agency

Background Strategy (Vilnius March 2005) : to facilitate the introduction and promotion of education for sustainable development (ESD) in the UNECE region and thereby contribute to the realisation of our common vision. The aim of the Strategy: to encourage UNECE member States to develop and incorporate ESD into their formal education systems, in all relevant subjects, and in non-formal and informal education.

Objectives 1. Ensure that policy, regulatory and operational frameworks support ESD; 2.Promote SD through formal, non-formal and informal learning; 3.Equip educators with the competence to include SD in their teaching; 4. Ensure that adequate tools and materials for ESD are accessible; 5.Promote research on and development of ESD; 6. Strengthen cooperation on ESD at all levels within the UNECE region.

The process of developing indicators Establishment of Expert Group following Vilnius. Mandate is 'to develop indicators to measure the effectiveness of the implementation of the Strategy’. 1.Four meetings scheduled 2.Setting up a ‘framework’: using an evaluation model 3. Translating objectives into indicators: state of the art

1. Four meetings of the Expert Group : Representatives from different countries Meetings held: Ede (26-28 Sep) Geneva (31 Oct – 2 Nov) Meetings to come: Vienna (Mar 2006) The Hague (May 2006)?

2.An evaluation model that covers : a. The process of implementation b. The effectiveness of the implementation, as a qualitative feature of both the process and long- term effects of ESD and that helps to: c. Distinguish between different types of indicators in relation to different phases of the process of implementation

Evaluation model used Check list ……… y/n TYPE 1 Policy framework Direct/ Indirect Effects, Impact TYPE 0 Current situation Baseline TYPE 3 Output Outcome TYPE 4 Outcome Throughput Activities T=0 T= TYPE 2 Input

On indicators…. - Baseline data shows the existing situation in relation to an issue at a certain point in time -‘Checklist indicators’ provide information on initial policy, legislation, regulatory and governance measures taken by a government in order to implement the Strategy - ‘Input indicators’ provide information on a broader spectrum of activities taking place in terms of the implementation of the Strategy - ‘Output indicators’ provide information on the result of these activities - ‘Outcome indicators’ provide information on the possible impact due to the implementation of the Strategy, in particular its qualitative aspect in terms of values, attitudes and choices in favour of SD

3. Translating objectives into indicators: state of the art First draft of indicators prepared and submitted for comments to Steering Committee (December 2005) For each objective a group of indicators and underlying questions was determined. With regard to the issue of ‘indigenous people’ (not a separate objective), it was proposed that a description on how their knowledge is conserved, used and promoted, be considered as an indicator.

Draft list of indicators: see hand-out Subject for evaluation: objectives of the Strategy Indicators Objective 1 Ensure that policy, regulatory and operational frameworks support the promotion of ESD 1.1 Organisation of the institutional arrangements - Not started (0 yes) - In progress (1-2 Yes) - Developing (3-5 Yes) - Completed (6 Yes)

IndicatorsUnderlying questions 1.1 Organisation of the institutional arrangements - Not started (0 yes) - In progress (1-2 Yes) - Developing (3-5 Yes) - Completed (6 Yes) (a)Is the Strategy available in your national[1] language(s)[2] Yes/No[1][2] (b) Do you have a coordinating body for implementation of the Strategy? Yes/No Pls. describe its mandate and coordinating mechanism. (c) Do stakeholders participate in the coordinating structure? Yes/No Etc.

Underlying questions Indicator type Means & Source of Verification Status of indicator Time-frame for completion (a) Is the Strategy available in your national [1] language(s) [2] Yes/No [1][2] Qualitative ‘Checklist’ Government reports RequiredPhase I (b) Do you have a coordinating body for implementation of the Strategy? Yes/No Qualitative ‘Checklist’ Government reports Required Phase I Etc.

Subject for evaluation: objectives of the Strategy Indicators Objective 1 Ensure that policy, regulatory and operational frameworks support the promotion of ESD 1.2 Implementation of the policy, regulatory and operational frameworks support the Strategy.

IndicatorsUnderlying questions 1.2 Implementation of the policy, regulatory and operational frameworks support the Strategy. (a)Do you have a national Strategy on SD? Yes/No (b) If yes, is ESD a part of this Strategy? Yes/No Pls. describe its mandate and coordinating mechanism. (c) If not, is ESD addressed in any other national policy document? Yes/No Explain how it is included. Etc.

Underlying questions Indicator type Means & Source of Verification Status of indicator Time- frame for completion (a) Do you have a national Strategy on SD? Yes/No Qualitative ‘Checklist’ Government reports RequiredPhase I

At the next meetings the experts… …w ill focus on consistency and validation and deletion of duplications in the draft. …will work further on the grouping of underlying questions in order to develop aggregated indicators.

Discussion……………………………..