EXPERIENCES FROM DISTRIBUTED REGISTERING OF METADATA IN METAPLUS Klas Blomqvist and Lars-Göran Lundell Statistics Sweden.

Slides:



Advertisements
Similar presentations
1 Statistics Norway Information Architecture – some challenges ODaF meeting, Colchester April 2008 Rune Gløersen Director Department for IT and.
Advertisements

National Institute of Statistics, Geography and Informatics (INEGI) Implementation of SDMX in Mexico.
Towards a simpler and more efficient BR June 19, 2007 ICES-III Montréal (QC)
Access to Economic and Social Data via the UK Data Archive Jack Kneeshaw UKDA.
An Introduction to the UK Data Archive and the Economic and Social Data Service November 2007 Jack Kneeshaw, UKDA.
Federal Department of Home Affairs FDHA Federal Statistical Office FSO Meeting of the OECD Expert Group on SDMX September, OECD, Paris Centralized.
& Slovak Archive of Social Data “SASD” and DDI 3 IASSIST/IFDO Conference, Tampere, Juraj.
Mogens Grosen Nielsen Statistics Denmark
Implementation of GSBPM, DDI and SDMX reference metadata at Statistics Denmark UNECE workshop 5-7 May 2015 Mogens Grosen Nielsen
1 Introduction The Database Environment. 2 Web Links Google General Database Search Database News Access Forums Google Database Books O’Reilly Books Oracle.
Chapter 1 Database Systems. Good decisions require good information derived from raw facts Data is managed most efficiently when stored in a database.
World Bank, Africa Region, Africa Household Survey Databank - The World Bank - Africa.
The Statistical Metadata System: its role in a statistical organization Jana Meliskova Joint UNECE / Eurostat / OECD Work Session on Statistical Metadata.
Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and.
Distributed Access to Data Resources: Metadata Experiences from the NESSTAR Project Simon Musgrave Data Archive, University of Essex.
SDMX and DDI Working Together Technical Workshop 5-7 June 2013
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
Met a-data Resources in Europe: within NSIs and from Dosis Projects Wilfried Grossmann Department of Statistics and Decision Support Systems University.
Overview of quality work in Statistics Denmark Kirsten Wismer.
CASE STUDY: STATISTICS NORWAY (SSB) Jenny Linnerud and Anne Gro Hustoft Joint UNECE/Eurostat/OECD work session on statistical metadata (METIS) Luxembourg.
Statistics Sweden Results from operations in 2006: 146 publications 356 press releases commissions 3,7 million visitors at
February 17, 1999Open Forum on Metadata Registries 1 Census Corporate Statistical Metadata Registry By Martin V. Appel Daniel W. Gillman Samuel N. Highsmith,
BAIGORRI Antonio – Eurostat, Unit B1: Quality; Classifications Q2010 EUROPEAN CONFERENCE ON QUALITY IN STATISTICS Terminology relating to the Implementation.
Lisbone, March ALBANIAN METADATA AlbMeta Prepared by INSTAT Working Group.
Statistics New Zealand’s End-to-End Metadata Life-Cycle ”Creating a New Business Model for a National Statistical Office if the 21 st Century” Gary Dunnet.
Database Management System Prepared by Dr. Ahmed El-Ragal Reviewed & Presented By Mr. Mahmoud Rafeek Alfarra College Of Science & Technology- Khan younis.
Statistics Sweden’s model for a Central Metadata Repository Eva Holm Geneva,
1 1 Developing a framework for standardisation High-Level Seminar on Streamlining Statistical production Zlatibor, Serbia 6-7 July 2011 Rune Gløersen IT.
Developing and applying business process models in practice Statistics Norway Jenny Linnerud and Anne Gro Hustoft.
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
SDMX and Metadata SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata.
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Recent development in the metadata area at Statistics Sweden Klas Blomqvist
MetaPlus Klas Blomqvist Statistics Sweden Research and Development – Central Methods
Integrated metadata systems History Status Vision Roadmap
Metadata Framework for a Statistical Data Warehouse
RECENT DEVELOPMENT OF SORS METADATA REPOSITORIES FOR FASTER AND MORE TRANSPARENT PRODUCTION PROCESS Work Session on Statistical Metadata 9-11 February.
1 The GSBPM and ESS statistical business process metadata Session 4 H. Linden, Unit B6 Eurostat Workshop on Statistical Metadata (METIS) (Geneva, 5-7 October.
3-1 Modeling Basic Entities DBMS Create Sort Search Addition Deletion Modification Create Sort Search Addition Deletion Modification DBMS is a Software.
Developing a metadata system for microdata About the project of developing a system for description of microdata at Statistics Sweden.
1 Process Orientation at statistics Sweden – Implementation and Initial Experiences IAOS Conference, October 15, 2008 Mats Bergdahl, Deputy Director Process.
TRITON - An event driven SOA architecture MSIS Jakob Engdahl, Statistic Sweden
Development Account: 6th Tranche Strengthening the capacity of National Statistical Offices (NSOs) in the Caribbean Small Island Developing States to fulfill.
MANAGEMENT OF STATISTICAL PRODUCTION PROCESS METADATA IN ISIS
Prepared by: Galya STATEVA, Chief expert
Contents Introducing the GSBPM Links to other standards
Streamlining the Statistical Production in TurkStat Metadata Studies in TURKSTAT High Level Seminar for Eastern Europe, Caucasus and Central Asia Countries.
Variables documentation system in Statistics Norway
WP1 Video analysis and annotation WP5a Architecture and Interfaces
A generic production environment - use of GSIM in Statistics Sweden
Warehouse approach: reusing data
Improving Statistical Literacy at Statistics Finland
Metadata in the modernization of statistical production at Statistics Canada Carmen Greenough June 2, 2014.
2. An overview of SDMX (What is SDMX? Part I)
Integrated Statistical Information System (ISIS) in Croatia By Maja Ledić Blažević, Senior Advisor, Research & Development Dept. and Branka Cimermanović,
2. An overview of SDMX (What is SDMX? Part I)
DDI-L in the Production of Official Statistics
ESS.VIP VALIDATION An ESS.VIP project for mutual benefits
Agenda Context of the BR Redesign Redesign Objectives Redesign changes
Chapter 1: The Database Environment
The Database Environment
Role and development of the metadata system in Statistics Norway
GSBPM AND ISO AS QUALITY MANAGEMENT SYSTEM TOOLS: AZERBAIJAN EXPERIENCE Yusif Yusifov, Deputy Chairman of the State Statistical Committee of the Republic.
The Database Environment
Discussion Topic iv, Metadata and quality reporting
Annegrete Wulff Statistics Denmark
Work Session on Statistical Metadata (Geneva, Switzerland May 2013)
Joint UNECE/Eurostat/OECD
Introduction to reference metadata and quality reporting
Presentation transcript:

EXPERIENCES FROM DISTRIBUTED REGISTERING OF METADATA IN METAPLUS Klas Blomqvist and Lars-Göran Lundell Statistics Sweden

Agenda Background –The metadata system –Organisational impact –Reorganisation Experiences Future plans

Statistics Sweden’s metadata system SCBDOK Description of the statistics MetaPlus Metadata repository SCBDOK MetaPlus Description of the statistics KDB Quality Declaration

Organisational impact Decentralised organisation –Strong subject matter departments –Functional departments Decentralised registration of metadata –Central support and coordination (R&D dept.) –Central dissemination (Info dept.)

Organisational impact New organisation –The Process Department –The Research and Development Department –The Communication Department –Classifications, metadata and content harmonisation (KMI)

Re-organising Statistics Sweden Standardised production and tools –Process orientation –Customer focus –Efficiency –Standardisation –Quality control

MetaPlus - Contents Standard variables Variables Object classes Classifications and value domains Registers created and used Population

MetaPlus current functionality, some examples Documentation Reuse Harmonisation Classifications Variable groups Advanced search Web interface Longitudinal registers Time series Historical information Administration Personal Data Act Administration System Archiving

MetaPlus - Model Object class Value domain Context Population Variable Population Context variable Object variable Register Register version Register variant Conceptual value domain Value

Registering metadata with MetaPlus Organisational issues for registering metadata –Decentralised organisation –Stovepipe production model –Documentation is a burden The KMI Group Networks

The KMI Group Governance and development of the metadata system –Implementation and maintenance of MetaPlus –User training, helpdesk and support –Presentation on the web Harmonisation –Classifications and classification related methods –Contents within the metadata systems

The documentation network All departments represented ”Standard” PCA – Supplying methodology resources Bridge between central knowledge and subject matter expertise

PCA Graphical view Dept. ADept. B KMI KOM

Contents Harmonisation History: The Metadok system A constant demand Lack of understanding from users Stepwise approach 1. Classify contents Statistical, Administrative and General variables 2.Remove duplicates 3.Subject matter control

Statistics and evaluation The Management –Monitors overall progress –Follows up and takes relevant actions The KMI Group –Follows up and evaluates the detailed contents of the MetaPlus database –Reports to Management

Experiences from working with MetaPlus Disadvantages of the decentralised mode: –Central control is more difficult –Coordination and harmonisation of contents is more difficult –Registration of documentation is not always prioritised locally

Experiences from working with MetaPlus Advantages of using a decentralised mode: –Relatively sparse and efficient use of central resources –Enforces knowledgeable participation from the subject matter specialists –Possibility to join the metadata system with other systems

MetaPlus and archiving Long-term archiving –Data sent to the National Archives Dedicated archiving system –Creates archive files in required format –Converts archive files to database tables –Uses MetaPlus information Metadata from MetaPlus and SCBDOK is a required part of the archived material

Future plans Web presentation of metadata based on the MetaPlus database –First version to be launched later this year –Documentation (variables, micro registers, statistical units, populations, etc) –Classifications MetaPlus used by other Swedish providers of statistics

Future plans Planned additions –Web presentation will include links between metadata on micro and macro levels –End-user tool for metadata driven production of tables –Expanded classification database

Use in the life cycle