ESSnet on Data Warehousing 4th Workshop Maia Ennok 20th. of March 2013

Slides:



Advertisements
Similar presentations
Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
Advertisements

Rgu: Information management Management of target student numbers Working group.
The governance of metadata management in the S-DWH
Dr Gordon Russell, Napier University Unit Data Dictionary 1 Data Dictionary Unit 5.3.
Best practice case: Comparing the implementations of the Irish CDM and the Dutch DSC ESSnet on microdata linking and data warehousing in statistical production.
--What is a Database--1 What is a database What is a Database.
Information Integration. Modes of Information Integration Applications involved more than one database source Three different modes –Federated Databases.
1 Introduction The Database Environment. 2 Web Links Google General Database Search Database News Access Forums Google Database Books O’Reilly Books Oracle.
Metadata for the S-DWH ‒ an overview Lars-Göran Lundell Statistics Sweden.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
Metadata management and statistical business process at Statistics Estonia Work Session on Statistical Metadata (Geneva, Switzerland 8-10 May 2013) Kaja.
M ETADATA OF NATIONAL STATISTICAL OFFICES B ELARUS, R USSIA AND K AZAKHSTAN Miroslava Brchanova, Moscow, October, 2014.
Metadata for a Statistical Data Warehouse Lars-Göran Lundell Statistics Sweden Luxembourg 22 September 2011.
m. rugsėjo 25 d. Questionnaire on the use of software tools in S-DWH Centre of competence on data warehousing Questionnaire on the.
Introduction to Database Systems
Re-Implementing ERM MENA-IUG 5 th Annual Conference 1-2 November 2010.
Interactive session: Metadata Maia Ennok Head of Data Warehouse Service Statistics Estonia
MOME MOME: An advanced measurement meta-repository IPS-MoMe Workshop, Warsaw, Poland March 14, 2005 Felix Strohmeier Authors:
0 A Workable Solution for Basic Metadata January 9, 2006.
ESS-net DWH ESSnet DWH - Metadata in the S-DWH Harry Goossens – Statistics Netherlands Head Data Service Centre / ESSnet Coordinator
2 Copyright © Oracle Corporation, All rights reserved. Defining Data Warehouse Concepts and Terminology.
Explaining the statistical data warehouse (S-DWH)
Chapter(1) Introduction and conceptual modeling. Basic definitions Data : know facts that can be recorded and have an implicit. Database: a collection.
CBSOR,Indian Statistical Institute 30th March 07, ISI,Kokata 1 Digital Repository support for Consortium Dr. Devika P. Madalli Documentation Research &
IS 325 Notes for Wednesday August 28, Data is the Core of the Enterprise.
Copyright © 2007 Ramez Elmasri and Shamkant B. Navathe Slide
DATAWHERE - MIAB1 DATAWHERE The MIAB Solution to Information Support and Data Conversion/Migration 통신망 연구실 석사 3 학기 임 수 정.
Work packages SGA II ESSnet on microdata linking and data warehousing in statistical production Harry Goossens – Statistics Netherlands Head Data Service.
Metadata “Data about data” Describes various aspects of a digital file or group of files Identifies the parts of a digital object and documents their content,
Open GSBPM compliant data processing system in Statistics Estonia (VAIS) 2011 MSIS Conference Maia Ennok Head of Data Warehouse Service Data Processing.
Metadata By N.Gopinath AP/CSE Metadata and it’s role in the lifecycle. The collection, maintenance, and deployment of metadata Metadata and tool integration.
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
ESS-net DWH ESSnet on microdata linking and data warehousing in statistical production Harry Goossens – Statistics Netherlands Head Data Service Centre.
By N.Gopinath AP/CSE.  The data warehouse architecture is based on a relational database management system server that functions as the central repository.
Metadata Framework for a Statistical Data Warehouse
RECENT DEVELOPMENT OF SORS METADATA REPOSITORIES FOR FASTER AND MORE TRANSPARENT PRODUCTION PROCESS Work Session on Statistical Metadata 9-11 February.
Copyright (c) 2014 Pearson Education, Inc. Introduction to DBMS.
Database Administration Basics. Basic Concepts and Definitions  Data Facts that can be recorded and stored  Metadata Data that describes properties.
ESS-net DWH ESSnet on microdata linking and data warehousing in statistical production.
Harry Goossens Centre of Competence on Data Warehousing.
Best practice case Finland / Estonia 22th. of September 2011 Maia Ennok.
Database Environment CPSC 356 Database Ellen Walker Hiram College.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Statistics Estonia's new system for statistical data activity processing (VAIS) ITDG Luxembourg 2010 Allan Randlepp.
1 CASE Computer Aided Software Engineering. 2 What is CASE ? A good workshop for any craftsperson has three primary characteristics 1.A collection of.
Outline Types of Databases and Database Applications Basic Definitions
MANAGEMENT OF STATISTICAL PRODUCTION PROCESS METADATA IN ISIS
Moving on : Repository Services after the RAE
Prepared by: Galya STATEVA, Chief expert
S-DWH layered architecture – Statiscs Finland
at Statistics Netherlands
Generic Statistical Business Process Model (GSBPM)
YTY − an integrated production system for business statistics
Data Resource Management
The implementation of a more efficient way of collecting data
Chapter 1: The Database Environment
Methodology Working Group Luxemburg
2. An overview of SDMX (What is SDMX? Part I)
Metadata Framework as the basis for Metadata-driven Architecture
Chapter 1: The Database Environment
SDMX in the S-DWH Layered Architecture
The Database Environment
Metadata The metadata contains
Data Resource Management
The Database Environment
ESTP course on Statistical Metadata – Introductory course
MIS 385/MBA 664 Systems Implementation with DBMS/ Database Management
Managing the Institutional Repository for OA Khawulile Radebe: Librarian: Repository Administrator & Metadata.
Work Session on Statistical Metadata (Geneva, Switzerland May 2013)
Presentation transcript:

ESSnet on Data Warehousing 4th Workshop Maia Ennok 20th. of March 2013 Metadata System ESSnet on Data Warehousing 4th Workshop Maia Ennok 20th. of March 2013

The S-DWH 8.12.2018 Maia Ennok, Metadata System

Metadata layer A metadata layer is a conceptual term that refers to all metadata in a data warehouse, regardless of logical or physical organisation. A metadata system is a system for all metadata in the metadata layer. 8.12.2018 Maia Ennok, Metadata System

Goal of the Metadata System of S-DWH Facilitate and support the operation of the S-DWH 1.4 delivery „Definition of the functionalities of a metadata system to facilitate and support the operation of the S‑DWH“ 8.12.2018 Maia Ennok, Metadata System

Statistical Metadata System of CMF Model for integrated management of SMS 8.12.2018 Maia Ennok, Metadata System

Functionalities of Metadata System Metadata management: Metadata creation Metadata usage Metadata maintenance Metadata evaluation …………..functionality groups 8.12.2018 Maia Ennok, Metadata System

Metadata creation Metadata creation is implementing metadata to the metadata system by creating or collecting metadata. List of functionalities: manual creation; automated creation; harvesting from other systems; manual import from files; creating links between metadata objects. 8.12.2018 Maia Ennok, Metadata System

Metadata usage All the metadata must be deployed meaning metadata must be available to users (people, systems) in the right form and with the right tools. List of functionalities: search; metadata export; international use. 8.12.2018 Maia Ennok, Metadata System

Metadata maintenance The role of metadata maintenance is to ensure that all metadata stored in the metadata repository are up-to-date for ongoing use. List of functionalities: maintenance of metadata history (versioning, update); updating meta models in metadata repository; updating links between metadata objects; updating users and rights. 8.12.2018 Maia Ennok, Metadata System

Metadata evaluation In metadata system there should be functionalities to evaluate the quality of metadata and to assure that metadata has high quality. List of functionalities: metadata validation (for example check links between metadata objects); standards usage 8.12.2018 Maia Ennok, Metadata System

The S-DWH 8.12.2018 Maia Ennok, Metadata System

In which layers you have metadata functionalities(multiple mark)? Source Layer Integration Layer Interpretation and Analysis Layer Access Layer None of the above 8.12.2018 Maia Ennok, Metadata System

Metadata functionalities per layer Metadata Creation Metadata Usage Metadata Maintenance Metadata Evaluation Source Layer X Integration Layer Interpretation and Analysis Layer Access Layer 8.12.2018 Maia Ennok, Metadata System

Metadata Subsets Statistical metadata are data about statistical data Process metadata are metadata that describe the expected or actual outcome of one or more processes using evaluable and operational metrics Quality metadata are any kind of metadata that contribute to the description or interpretation of the quality of data. Technical metadata are metadata that describe or define the physical storage or location of data Authorisation metadata are administrative data that are used by programmes, systems or subsystems to manage users’ access to data 8.12.2018 Maia Ennok, Metadata System

Which metadata subsets you have in your metadata system (mark multiple)? Statistical metadata Process metadata Quality metadata Technical metadata Authorization metadata None of the above 8.12.2018 Maia Ennok, Metadata System

Integrated metadata system (IMETA) Statistics Estonia MMX Metadata Repository Metamodels in metadata repository Statistical metadata(Neuchatel Terminology Model) Technical metadata (Relational Database Metamodel) Process metadata (XDTL Metamodel) Authorization metadata (Role-Based Access Control Model) … Links between different kind of metadata 8.12.2018 Maia Ennok, Metadata System

Do you have links between different kind of metadata(multiple mark)? No links Links between objects of statistical metadata (ex. variable and classifier) Links between statistical metadata and technical metadata Links between statistical metadata and process metadata Links between all kind of metadata 8.12.2018 Maia Ennok, Metadata System

Links between columns and variables in iMETA 8.12.2018 Maia Ennok, Metadata System

Functionalities in iMETA Metadata creation manual or automated creation; import from files or from other systems; implementing metadata repository; creating links between metadata objects Metadata usage search; metadata export; international use Metadata maintenance maintenance of metadata history (versioning, update, etc);updating meta models in metadata repository; updating links between metadata objects; updating users and rights Metadata evaluation metadata validation (for example check links between metadata objects); standards usage 8.12.2018 Maia Ennok, Metadata System

Thank you!