1. Introduction to reference metadata and quality reporting
Remi Prual
Estonia
ESTP Training Course
“Advanced course on quality reporting”
Luxembourg, June 2018

2. Contents Definitions / Main characteristics / Objectives Quality
Metadata (structural metadata and reference metadata)
Quality reporting
Quality assessment
Quality assurance
Quality management

3. Definition: Quality
The degree to which a set of inherent characteristics fulfils requirements.
Context: Quality is a multi-faceted concept. The dimensions of quality that are considered most important depend on user perspectives, needs and priorities, which vary across groups of users.
ES CoP defines quality in terms of the institutional environment, statistical processes and statistical output.
Source: Eurostat's Concepts and Definitions Database / ISO 9000

4. Definition: Metadata
Information that is needed to be able to use and interpret statistics. Metadata describe data by giving definitions of populations, objects, variables, the methodology and quality.
Source: Eurostat's Concepts and Definitions Database
Remark:
A distinction is generally made between
structural metadata and reference metadata.

5. Definition: Structural metadata
Structural metadata is used to identify, formally describe or retrieve statistical data, such as dimension names, variable names, dictionaries, dataset technical descriptions, dataset locations, keywords for finding data etc.
For example, structural metadata includes the titles of the variables and dimensions of statistical datasets, as well as the units employed, code lists (e.g. for territorial coding), data formats, potential value ranges, time dimensions, value ranges of flags, classifications used, etc.
Source: Eurostat's Concepts and Definitions Database

6. Definition: Reference metadata
Reference metadata describes the contents and the quality of the statistical data from a semantic point of view. It includes explanatory texts on the context of the statistical data, methodologies for data collection and data aggregation as well as quality and dissemination characteristics.
In Eurostat this information is presented in files based on a standardised format (SIMS). These files are associated to the data series published by Eurostat on its web site.
Source: Eurostat's Concepts and Definitions Database

7. Definition: Quality reporting
Quality reporting underpins quality assessment, which in turn is the starting point for quality improvements. Thus, standards and guidelines for effective quality reporting are an essential aspect of the quality management / assurance framework.
Source: ESS Handbook for Quality reports
Quality report: A document conveying information about the quality of a statistical product or process.
Source: Eurostat's Concepts and Definitions Database
Quality objective: A quality objective is a quality oriented goal. A quality objective is something you aim for or try to achieve.

8. Definition: Quality assessment
Quality assessment: The part of quality assurance that focuses on assessment of fulfilling quality requirements (need or expectation that is stated, generally implied or obligatory).
Source: Eurostat's Concepts and Definitions Database / ISO9000
Quality improvement (actions): Quality improvement refers to anything that enhances an organization's ability to meet quality requirements. Quality improvement is one part of quality management.

9. Definition: Quality assurance
An organisation's guarantee that the product or service it offers meets the accepted quality standards. It is achieved by identifying what "quality" means in context; specifying methods by which its presence can be ensured; and specifying ways in which it can be measured to ensure conformance.
Source: Eurostat's Concepts and Definitions Database / ISO9000
The purpose of QA is to prevent defects from entering into the solution in the first place.

10. Definition: Quality management
A customer-focused management philosophy that seeks to continuously improve business processes using analytical tools and teamwork involving all employees.
Source: Eurostat's Concepts and Definitions Database / ISO9000

11. Definition: Quality management system
A set of interrelated or interacting elements that organizations use to direct and control how quality policies are implemented and quality objectives are achieved.
A process-based QMS uses a process approach to manage and control how its quality policy is implemented and quality objectives are achieved. A process-based QMS is a network of many interrelated and interconnected processes (elements).
Each process uses resources to transform inputs into outputs. Since the output of one process becomes the input of another process, processes interact and are interrelated by means of such input- output relationships. These process interactions create a single process-based QMS.
Source: Eurostat's Concepts and Definitions Database / ISO9000

12. Any questions?

13. References Eurostat quality framework Eurostat quality reporting
ESS Handbook for Quality reports 2014
Eurostat's Concepts and Definitions Database
ESS Quality Glossary