Yalta Seminar on Global Assessments, 2009 Eurostat and Global Assessments: Context, Approaches, Tools 3.1

Eurostat D1Yalta Seminar on Global Assessments, 2009 Assessments from the Eurostat’s point of view: –How do we define them? –What initiatives are we involved in? –What tools we use? Contents

Eurostat D1Yalta Seminar on Global Assessments, 2009 In the ESS, the culture – “tradition” – of assessments has long been established.

Eurostat D1Yalta Seminar on Global Assessments, 2009 Assessment – Overview of the Process Request for an assessment Selection of and agreement on an assessor team Joint preparation –Finalizing Assessment structure –Examining preparatory materials prepared by the Institute 1 or 2 missions –In latter case, rough draft after 1 st mission to be revised and finalised during 2 nd mission Agreeing on the final version of the draft – detailed revisions Dissemination

Eurostat D1Yalta Seminar on Global Assessments, 2009 Assessment – Structure Structure – depends on the purpose and intended scope of assessment –Goal: to assess the institutional aspects of the national statistical system and its technical and organisational capacity to produce and disseminate official statistics in all relevant areas –Focal areas: Legal basis National statistical system National statistical service Statistical production in various domains

Eurostat D1Yalta Seminar on Global Assessments, 2009 Assessment – Criteria Goal: to assess the compliance with international standards, norms, and recommendations Need to decide against which criteria the assessment will be conducted United Nations Fundamental Principles of Official Statistics? Eurostat Code of Practice? EU acquis communautaire in statistics – Statistical Requirements Compendium? IMF’s Data Quality Assessment Framework? Others?

Eurostat D1Yalta Seminar on Global Assessments, 2009 “What? Yet another assessment?” Any assessment puts a considerable pressure on National Statistical Institute’s time and resources. Potential ideas –Long-term planning for assessments, especially vis-à-vis country statistical programming and future assistance needs? –Using assessments by one organisation as a reference point for assessments by other organisations? –Any tools to make an assessment process less resource- intensive? Focus on self-assessment as a potential tool to reduce preparation time, mission load, and resources and time required from the Institute?

Eurostat D1Yalta Seminar on Global Assessments, 2009 How assessments can be helpful in the context of the relations with the European Union? (1) Statistics is rapidly gaining importance in EU cooperation, negotiations, and assistance to both European Neighbourhood Partnership countries and Central Asia. International and EU comparability Quality Transparency Statistics usually emerges as one of the cornerstone issues in negotiations for closer cooperation. –Through statistics we measure progress in nearly all priority areas.

Eurostat D1Yalta Seminar on Global Assessments, 2009 How assessments can be helpful in the context of the relations with the European Union? (2) Assessment of National Statistical Institute/National Statistical System Facilitating EU cooperation initiatives Defining priorities for EU assistance instruments TWINNING TAIEX

Eurostat D1Yalta Seminar on Global Assessments, 2009 Eurostat external assessment approaches Existing Peer Reviews (PR) In an advanced development/commencement stage Light Peer Reviews (LPR) Adapted Global Assessments (AGA)

Eurostat D1Yalta Seminar on Global Assessments, 2009 Eurostat Peer Reviews All EU National Statistical Institutes and Eurostat were subject to a peer review during Review established Institute’s compliance with the European Statistics Code of Practice. –The scope was limited to the areas related to the institutional environment and dissemination of statistics. 3-day country mission of 3 reviewers (2 experts from National Statistical Institutes, 1 – from Eurostat). Eurostat Code of Practice Self-Assessment questionnaire – central assessment basis.

Eurostat D1Yalta Seminar on Global Assessments, 2009 Light Peer Reviews vs. Adapted Global Assessments Light peer reviews (LPRs) –intended for countries with advanced statistical systems that are about to join the EU (candidate countries) –precursors for standard ESS peer reviews Adapted global assessments (AGAs) –adapted to the needs of countries with European perspective or with a stated intention to align their statistical systems to that of the EU

Eurostat D1Yalta Seminar on Global Assessments, 2009 Light Peer Reviews –Candidate and potential candidate countries –One LPR country mission –Before the LPR mission self-assessment (questionnaire based on the ESS-PR version) specific training on LPR provided to the reviewed countries –Reviewers 2 ESS peers 1-2 observers from group of reviewed countries 1 Eurostat representative –Report to include recommendations for improvement actions covering all principles of the European Code of Practice with a view to future assistance needs; will not include rankings

Eurostat D1Yalta Seminar on Global Assessments, 2009 Adapted Global Assessments (1) –Could be requested by countries interested in deeper approximation with the EU statistical standards –Details adapted to the circumstances of the reviewed country and relevant EU policy framework regarding scope of elements of traditional global assessment degree of assessment of statistical areas against international standards and/or EU acquis –Sections on legislation, national statistical system, national statistical institute, and statistical domains –Can be repeated every 4-5 years

Eurostat D1Yalta Seminar on Global Assessments, 2009 Adapted Global Assessments (2) –Before the AGA mission(s) self-assessment (SMIS+ and/or questionnaire based on the ESS-PR version) specific training on AGA provided to the reviewed countries –Reviewers 2 ESS peers 2 observers from the group of reviewed countries 2 Eurostat representatives –Report to include recommendations for improvement actions with a view to future assistance needs; will not include rankings

Eurostat D1Yalta Seminar on Global Assessments, 2009 Eurostat tools – focus on self-assessment (1) Statistical Management Information System – SMIS+ –Web software tool used to monitor country compliance with the EU acquis in the field of statistics. Focus - statistical domains. –Clearly defines the acquis and up-to-date Eurostat requirements Predefined structure of statistical themes and modules with their legal basis and the required datasets on which Institutes submit information. –All countries can use the application, submit their information to Eurostat, have it reviewed, and use the generated Compliance Monitoring Reports for Institute’s needs. It can be used as an exhaustive compilation of information on the statistical production by the Institute.

Eurostat D1Yalta Seminar on Global Assessments, 2009 Eurostat tools – focus on self-assessment (2) Eurostat Code of Practice Self-Assessment questionnaire –Extensive questionnaire that can be used to self-assess against all principles and indicators of the Code of Practice –Focus on legal and institutional environment, addresses user-relations –Can complement the SMIS+ to have an in-depth overview of both institutional issues and statistical domains –A few limitations: not all questions are appropriate for all countries; therefore, the questionnaire may need to be revised accordingly certain areas are not addressed in depth: national statistical system, statistical programming

Eurostat D1Yalta Seminar on Global Assessments, 2009 Resources –European Statistics Code of Practice uments/code_practice.pdfhttp://epp.eurostat.ec.europa.eu/portal/page/portal/quality/doc uments/code_practice.pdf –Eurostat Peer Reviews e_of_practice/peer_reviewshttp://epp.eurostat.ec.europa.eu/portal/page/portal/quality/cod e_of_practice/peer_reviews –SMIS+ (requires registration on CIRCA) =DSP_LOGIN&clearhttps://webgate.ec.europa.eu/smis/login/index.cfm?TargetUrl =DSP_LOGIN&clear

Eurostat D1Yalta Seminar on Global Assessments, 2009 Thank You!