5b. SDMX and reference metadata: guideline examples

Slides:



Advertisements
Similar presentations
Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and.
Advertisements

Metadata management and statistical business process at Statistics Estonia Work Session on Statistical Metadata (Geneva, Switzerland 8-10 May 2013) Kaja.
REFERENCE METADATA FOR DATA TEMPLATE Ales Capek EUROSTAT.
Chapter 9: Data quality and metadata Ilaria DiMatteo United Nations Statistics Division The 4 th meeting of the Oslo Group on energy statistics Ottawa,
Eurostat 1 7a. Practical use case 1: Pesticides Use Project Blanaru Cristina Eurostat Unit B5: “Central data and metadata services” SDMX Basics course,
Eurostat achievements and challenges Emanuele Baldacci, Director European Commission - Eurostat Director Methodology; Corporate statistical.
1 Integration of the Eurostat and ESS Metadata Systems A. Götzfried Head of Unit B6 Eurostat.
SDMX and Metadata SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.
1 5a. SDMX and reference metadata exchanges Bogdan ZDRENTU Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Work Session on Statistical Metadata 2013 Session III: Metadata in the Statistical Business Process Better documenting statistical business processes:
Eurostat 1.SDMX: Background and purpose 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
1 Enhancing data quality by using harmonised structural metadata within the European Statistical System A. Götzfried Head of Unit B6 Eurostat.
1 Quality reporting within the Eurostat and the ESS metadata systems August Götzfried and Håkan Linden Eurostat Unit B6: Reference databases and metadata.
Quality at a Glance: Documentation of Quality Indicators at Statistics Austria European Conference on Quality in Official Statistics Rome, 8-11 July 2008.
13 November, 2014 Seminar on Quality Reports QUALITY REPORTS EXPERIENCE OF STATISTICS LITHUANIA Nadiežda Alejeva Head, Price Statistics.
Quality Reports Ukraine November Regulation 223/2009 on European Statistics European Statistics shall be produced  on the basis of uniform standards.
SDMX Basics course, March 2016 Eurostat SDMX Basics course, March Introducing the Roadmap Marco Pellegrino Eurostat Unit B5: “Data and.
United Nations Economic Commission for Europe Statistical Division GSBPM in Documentation, Metadata and Quality Management Steven Vale UNECE
Quality declarations Study visit from Ukraine 19. March 2015
The Eurostat Metadata Handler Götzfried Eurostat (Head of Unit B6)
Prepared by: Galya STATEVA, Chief expert
Structural and reference metadata in the European Statistical System
Item 6 - Introduction to ESS Metadata Handler
Seminar on ESA 2010 Metadata
The CVD Metadata Handler
Dissemination Working Group
Usage of National Reference Metadata Editor (NRME)
Documentation of statistics
11. The future of SDMX Introducing the SDMX Roadmap 2020
The new metadata structure & Country Specific Notes
Statistics Denmark’s presentation of metadata
2. An overview of SDMX (What is SDMX? Part I)
Time Use Survey data processing and dissemination 17 July 2014
6.1 Quality improvement Regional Course on
Working Group "LAbour MArket Statistics" October 2013
5. Detail: Main SDMX objects for. metadata exchange. (What is SDMX
Quality assessment ESTP Training Course “Quality Management and survey Quality Measurement” Rome, 24 – 27 September 2013 Giorgia Simeoni Researcher Unit.
Provisions of totals and zero records (point for decision)
What is next? H. Linden Eurostat, Unit B5
ESS VIP programme: Cross-cutting project on ESS data warehouses for production and dissemination John Allen Agenda point 5 Dissemination Working Group.
Quality Assurance in the European Statistical System
Education and Training Statistics Working Group – 2-3 June 2016
National reference metadata and the National Reference Metadata Editor
August Götzfried Eurostat unit B 4
Working Group "Agriculture and Environment – Pesticides Statistics" September Quality reports B. Zdrentu V. Delhaxhe-Wolmering Eurostat.
Working Group "Education and Training Statistics" April 2013
SDMX Progress and implementation A. Götzfried, Unit B6
Quality Reporting in CBS
Legislative strategy for cross-cutting ESS legislation
Education and Training Statistics Working Group, May 2011
Standards and guidelines for reference metadata
Quality reporting in the ESS - State of play and next steps
Metadata on quality of statistical information
Prodcom Working Group Item Quality reporting and indicators
M. Henrard, B5 N. Buysse and H. Linden, B6 Eurostat
Annegrete Wulff Statistics Denmark
1. SDMX: Background and purpose
2.7 Annex 3 – Quality reports
13. Knowing more about SDMX
Work Session on Statistical Metadata (Geneva, Switzerland May 2013)
ESTP course on Statistical Metadata – Introductory course –
Joint UNECE/Eurostat/OECD
ESS technical standards and tools for quality reporting
Introduction to reference metadata and quality reporting
IA on quality reporting
7. Introduction to the main SDMX objects for metadata exchange
ESS conceptual standards for quality reporting
Interoperability of metadata systems: Follow-up actions
Approach to SIMS implementation
Improving the interoperability of metadata exchange in the ESS
Presentation transcript:

5b. SDMX and reference metadata: guideline examples Bogdan ZDRENTU Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, 27-29 October 2015

Guidelines for recording reference metadata according to ESMS

The Euro SDMX Metadata Structure (ESMS)

Guidelines for recording and disseminating metadata ESMS is currently to be used for dissemination of metadata on the web and therefore rather user- oriented. The information in ESMS is to be more synthesised compared to a comprehensive quality report according to the ESS Standard for Quality Reports (ESQRS).

Guidelines for recording and disseminating metadata Practical Guidelines for reporting on reference metadata are provided by the EURO-SDMX Metadata Structure which contains the concept names, concept codes, short "Descriptions" and "ESS Guidelines" on what is to be reported a supporting document "Good Practices for reference metadata in ESMS" which is available in the application ESS MH

The Euro SDMX Metadata Structure (ESMS)

Attachment level  Maintenance burden at an acceptable level! When many tables or datasets are produced on the basis of one statistical survey or data source, it is recommended that only one (identical) ESMS file is used. If a large part of information is repeated in a number of ESMS files, the production unit should try to upgrade the attachment levels of these files towards a higher one.

Timeliness The concepts in ESMS files should be checked at least once per year or more frequent if e.g. the data quality has deteriorated or improved or if more reporting on data quality is feasible. If data quality reports or other information on data are available, this information should be included into the ESMS. Generally, some information should be provided for each concept.

Completeness The information in ESMS is to be more synthesised and concise compared to a comprehensive quality report. But if e.g. no data quality reports or other information is available, at least basic information should be inserted. Hyperlinks and attachments of central documents are helpful in order to provide complementary sources for further detailed information.

Completeness Information not available or not applicable If no information is available this should be flagged as "Not available". An indication on the plans to provide e.g. quality related information in the future should be included, though. If a concept is not relevant it should be indicated as "Not applicable".

Examples – how it should not be…

"Not available" and "Not applicable"

Metadata update

Completeness of information I

Completeness of information II

References to other sources & documents I

References to other sources & documents II

Annexes and Titles

Guidelines: sum up Keep the maintenance burden at an acceptable level and make sure that each dataset is covered by reference metadata. The metadata should be up-to-date and the user should be informed about that. Make use of standardised set phrases when no information can be provided. Give as much information as possible, but as concise as possible at the same time. Check on the accessibility and clarity of provided links and attached annexes.

Questions?