Metadata management and statistical business process at Statistics Estonia Work Session on Statistical Metadata (Geneva, Switzerland 8-10 May 2013) Kaja.

Slides:



Advertisements
Similar presentations
Federal Department of Home Affairs FDHA Federal Statistical Office FSO Meeting of the OECD Expert Group on SDMX September, OECD, Paris Centralized.
Advertisements

Implementation of GSBPM, DDI and SDMX reference metadata at Statistics Denmark UNECE workshop 5-7 May 2015 Mogens Grosen Nielsen
Business Case for Industriali- sation in Statistics Estonia: Small Example of a Large Trend MSIS 2013 Allan Randlepp Tuulikki Sillajõe.
WP.5 - DDI-SDMX Integration
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
Case Studies: Statistics Canada (WP 11) Alice Born Statistics UNECE Workshop on Statistical Metadata.
Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and.
Statistics New Zealand Classification Management System Andrew Hancock Statistics New Zealand Prepared for 2013 Meeting of the UN Expert Group on International.
Statistics New Zealand Classification Management System Andrew Hancock Statistics New Zealand Prepared for 2013 Meeting of the UN Expert Group on International.
M ETADATA OF NATIONAL STATISTICAL OFFICES B ELARUS, R USSIA AND K AZAKHSTAN Miroslava Brchanova, Moscow, October, 2014.
SDMX and DDI Working Together Technical Workshop 5-7 June 2013
1 Implementation of the SDMX Standard by the Federal State Statistics Service of the Russian Federation Alexander Surinov Head of the Federal State Statistics.
4 April 2007METIS Work Session1 Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis.
Population Census carried out in Armenia in 2011 as an example of the Generic Statistical Business Process Model Anahit Safyan Member of the State Council.
United Nations Economic Commission for Europe Statistical Division Part B of CMF: Metadata, Standards Concepts and Models Jana Meliskova UNECE Work Session.
Metadata Models in Survey Computing Some Results of MetaNet – WG 2 METIS 2004, Geneva W. Grossmann University of Vienna.
« 8-11 July 2008 « Metadata Life Cycle « STATISTICS PORTUGAL.
Statistics Portugal/ Metadata Unit Monica Isfan « Joint UNECE/ EUROSTAT/ OECD Work Session on Statistical Metadata.
CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic 1 Subsystem QUALITY in Statistical Information System Czech.
C onference on Data Quality for International Organisations (Rome, Italy, 7-8 July 2008) Session 1: Assessment of data quality The example of the Wages.
Electronic data collection system eSTAT in Statistics Estonia: functionality, authentication and further developments issues 4th June 2007 Maia Ennok,
Developing Statistical Information Systems and XML Information Technologies - Possibilities and Practicable Solutions Geneva,
Proposals on standardisation process in ESS, The Hague_ ESS net Preparation of Standardisation 1 Proposals on standardisation process.
InSPIRe Australian initiatives for standardising statistical processes and metadata Simon Wall Australian Bureau of Statistics December
Statistics Estonia on its way to improving efficiency UN ECE Seminar on New Frontiers for Statistical Data Collection Geneva, ‒ Tuulikki.
United Nations Statistics Division Work Programme on Economic Census Vladimir Markhonko, Chief Trade Statistics Branch, UNSD Youlia Antonova, Senior Statistician,
Metadata management in National Statistical Institutes and researcher access: an example Zoltán Vereczkei Hungarian Central Statistical Office Methodology.
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
Unified information system of statistical data collection, processing, storage and dissemination (Rosstat UIS ) Overview FEDERAL STATE STATISTICS SERVICE.
1 Integration of the Eurostat and ESS Metadata Systems A. Götzfried Head of Unit B6 Eurostat.
Metadata Working Group Jean HELLER EUROSTAT Directorate A: Statistical Information System Unit A-3: Reference data bases.
Open GSBPM compliant data processing system in Statistics Estonia (VAIS) 2011 MSIS Conference Maia Ennok Head of Data Warehouse Service Data Processing.
SDMX and Metadata SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
1 5a. SDMX and reference metadata exchanges Bogdan ZDRENTU Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Metadata Framework for a Statistical Data Warehouse
RECENT DEVELOPMENT OF SORS METADATA REPOSITORIES FOR FASTER AND MORE TRANSPARENT PRODUCTION PROCESS Work Session on Statistical Metadata 9-11 February.
1 Dissemination on Internet Experience of the Statistical Office of the Slovak Republic Dissemination on Internet Experience of the Statistical Office.
Harry Goossens Centre of Competence on Data Warehousing.
Agency of statistics of the Republic of Kazakhstan Astana, 2014 Prospects for the SDMX standard implementation in the Agency of statistics of the Republic.
The business process models and quality issues at the Hungarian Central Statistical Office (HCSO) Mr. Csaba Ábry, HCSO, Methodological Department Geneva,
13 November, 2014 Seminar on Quality Reports QUALITY REPORTS EXPERIENCE OF STATISTICS LITHUANIA Nadiežda Alejeva Head, Price Statistics.
Estonian experience in implementation and maintenance of statistical database using PX-Web Eda Fros Statistics Estonia UNECE Workshop on Developing Data.
National Bureau of Statistics of the Republic of Moldova 1 High Level Seminar for Eastern Europe, Caucasus and Central Asia Countries (EECCA) on 'Quality.
Statistical process model Workshop in Ukraine October 2015 Karin Blix Quality coordinator
United Nations Economic Commission for Europe Statistical Division GSBPM in Documentation, Metadata and Quality Management Steven Vale UNECE
Statistical Business Register Enterprise Groups in Latvia Sarmite Prole Head of Business Register Section Business Statics Department Central Statistical.
The Eurostat Metadata Handler Götzfried Eurostat (Head of Unit B6)
Prepared by: Galya STATEVA, Chief expert
5b. SDMX and reference metadata: guideline examples
Structural and reference metadata in the European Statistical System
Documentation of statistics
Generic Statistical Business Process Model (GSBPM)
11. The future of SDMX Introducing the SDMX Roadmap 2020
Three areas that have proved successful and one area where improvements are needed in the Statistical Office of Estonia by Tuulikki Sillajõe International.
Country Specific Notes Agenda point 11
The new metadata structure & Country Specific Notes
Metadata in the modernization of statistical production at Statistics Canada Carmen Greenough June 2, 2014.
ESSnet on Data Warehousing 4th Workshop Maia Ennok 20th. of March 2013
2. An overview of SDMX (What is SDMX? Part I)
2. An overview of SDMX (What is SDMX? Part I)
ESS technical standards and tools for quality reporting
Metadata Framework as the basis for Metadata-driven Architecture
Metadata use in the Statistical Value Chain
M. Henrard, B5 N. Buysse and H. Linden, B6 Eurostat
Annegrete Wulff Statistics Denmark
Work Session on Statistical Metadata (Geneva, Switzerland May 2013)
Joint UNECE/Eurostat/OECD
Petr Elias Czech Statistical Office
7. Introduction to the main SDMX objects for metadata exchange
Presentation transcript:

Metadata management and statistical business process at Statistics Estonia Work Session on Statistical Metadata (Geneva, Switzerland 8-10 May 2013) Kaja Sõstra, Eda Froš

Outline Overview of integrated metadata management system Statistical information system and business process model Current metadata projects Future plans Conclusions

Integrated metadata management system iMETA Outsourced project August 2010 – July 2011 Integration of iMETA with other subsystems of our statistical information system (SIS) Metadata driven SIS Bilingual application; metadata will be stored in Estonian and in English

Purposes of the new metadata management system To support the whole statistical business process; To enable the storage of metadata once for all usages; To act as an instrument for harmonising and standardising metadata; To act as a central repository for all subsystems and for various outputs regardless of purpose, media, format and time.

Source documents Neuchâtel Terminology Model – classification database object types and their attributes Neuchâtel Termonology Model – variables and related concepts MMX Metadata Framework – implementation of MOF (built on relational database) technology

Content of iMETA Metadata navigator Statistical activities Classifications Concepts Statistical units types and statistical characteristics Measurement units Information about questionnaires Legal acts Databases

General architecture of metadata system

User interface

Metadata navigator Metadata repository contains metadata managed by iMETA application and also metadata managed by other applications. Metadata navigator gives an overview of all metadata stored in metadata repository (terminology objects, SQL objects, etc.)

Classifications Classification – kind of umbrella that comprises one or several classification versions Classification version – structured list of mutually exclusive categories Classification variant – the original categories of classification version are split or regrouped to provide context-specific additions to the standard structure Correspondence tables

Classification screen

Statistical activities (I) Statistical activity –the collection, storage, transformation and distribution of statistical information In Statistics Estonia the concept of statistical activity includes not only the conducted statistical surveys, but also management of statistical registers, compilation of yearbooks and analytical publications as well as other works related to the production of statistics Every year a new version (instance) of statistical activity is being described

Statistical activities (II) The description of statistical activity is based on ESMS concepts, supplemented by special attributes needed for Statistics Estonia. All attributes are grouped as: General information Methodology Quality Dissemination VVIS (electronic data collection system) E-respondent New attributes and groups can be added

Statistical activity screen

Statistical activities (III) Description of statistical activities enables To present descriptions of surveys according to Euro- SDMX structure (ESMS) on the web To create a document of Statistical Programme for 5 years; To present list of conducted statistical activities with short description by years on the web To create XML file according to Euro-SDMX MSD

Defining variables

Simplified variables model

Architecture of the information system Dissemination Statistical registers Metadata system Data collection Processing Statistical analysis Persons Administrative registers Users Economic entities Data Warehouse iMETA VVIS ADAM eGeostat SRS VAIS eSTAT PX-Web Census-HUB KUNDE Analyse

2002 Statistical Farm Register CRM 2006 Px-web 1994 Statistical Business Register eStat 2006 VVIS economic entities 2006 economic entities 2001 metadata management 2011 iMeta project started 2011 system for statistical registers project started 2011 project started 2011 persons planned Generic Statistical Business Process Model project started 2012

Links between metadata repository and other systems

Current metadata projects Implementation of ESS metadata standards on describing statistical activities and disseminating data Describing reference metadata (in the metadata system) for all statistical activities according to ESMS. Modernisation of reference metadata describing and update processes Preparation for dissemination of reference metadata on the website Technical development of iMeta

Future plans Dissemination of ESMS based reference metadata on the web is planned on the 1st of July this year Release of concepts and definitions on the web of Statistics Estonia. Replacement of current HTML version of concepts and methodology in output database Further development of iMeta in line with developments of other components of statistical information system

Conclusions Several parallel developments course problems of specification common requirements for all systems. Unfortunately, all new developments bring along some changes in the metadata system Responsible unit and persons should be appointed for management of metadata Creation of new metadata, filling in the gaps and harmonisation is very labour-intensive. Support from management and other people in the office is essential for success. Special guidelines and rules should be created. All potential internal users of metadata system should be informed about the development process and involved in it.

Thank you for your attention!