GSIM Mapping to SDMX and DDI: Preliminary Findings and Status Arofan Gregory Metadata Technology METIS, May 6-8 2013, Geneva.

Slides:



Advertisements
Similar presentations
Status on the Mapping of Metadata Standards
Advertisements

Summary of Participant Interview Themes for GSIM Sprint 1 7 February 2012.
GSIM, CSPA, and Related Activities of the High-Level Group
Implementation of GSBPM, DDI and SDMX reference metadata at Statistics Denmark UNECE workshop 5-7 May 2015 Mogens Grosen Nielsen
Implementing a New Classification Management System at Statistics New Zealand Andrew Hancock, Statistics New Zealand Arofan Gregory, Metadata Technology.
SDMX and DDI: How Do They Fit Together in Practical Terms? Arofan Gregory The Open Data Foundation European DDI User’s Group 2011 Gothenburg, Sweden.
United Nations Economic Commission for Europe Statistical Division Standards-based Modernisation An update on the work of the High-level Group for the.
The Data Cube Vocabulary: Statistics in the Web of Linked Data Arofan Gregory Open Data Foundation WICS, Geneva, 5-7 May 2015.
Modernizing the Data Documentation Initiative (DDI-4) Dan Gillman, Bureau of Labor Statistics Arofan Gregory, Open Data Foundation WICS, 5-7 May 2015.
Producing and managing metadata Workshop on Writing Metadata for Development Indicators Lusaka, Zambia 30 July – 1 August 2012 Writing Metadata for Development.
Background Data validation, a critical issue for the E.S.S.
CES 2012 Paris 1 High Level Group for Strategic Developments in Business Architecture in Statistics Strategy Gosse van der Veen, Statistics Netherlands.
GSIM Stakeholder Interview Feedback HLG-BAS Secretariat January 2012.
WP.5 - DDI-SDMX Integration
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
NSI 1 Collect Process AnalyseDisseminate Survey A Survey B Historically statistical organisations have produced specialised business processes and IT.
Survey Data Management and Combined use of DDI and SDMX DDI and SDMX use case Labor Force Statistics.
Statistics New Zealand Classification Management System Andrew Hancock Statistics New Zealand Prepared for 2013 Meeting of the UN Expert Group on International.
Generic Statistical Information Model (GSIM) Thérèse Lalor and Steven Vale United Nations Economic Commission for Europe (UNECE)
Metadata management and statistical business process at Statistics Estonia Work Session on Statistical Metadata (Geneva, Switzerland 8-10 May 2013) Kaja.
A perspective from beyond the ESS Alistair Hamilton Director – Statistical Information Standards Australian Bureau of Statistics.
SDMX and DDI Working Together Technical Workshop 5-7 June 2013
Generic Statistical Information Model (GSIM) Thérèse Lalor and Steven Vale United Nations Economic Commission for Europe (UNECE)
3 rd Annual European DDI Users Group Meeting, 5-6 December 2011 The Ongoing Work for a Technical Vocabulary of DDI and SDMX Terms Marco Pellegrino Eurostat.
Integration Development Programme in the Field of Statistics of the Eurasian Economic Union for EEC THE EURASIAN ECONOMIC COMMISSION.
Standardisation Informal summary of ABS Perspective.
Background to the Generic Statistical Information Model (GSIM) Briefing Pack December
SDMX Standards Relationships to ISO/IEC 11179/CMR Arofan Gregory Chris Nelson Joint UNECE/Eurostat/OECD workshop on statistical metadata (METIS): Geneva.
Technical Overview of SDMX and DDI : Describing Microdata Arofan Gregory Metadata Technology.
GSIM implementation in the Istat Metadata System: focus on structural metadata and on the joint use of GSIM and SDMX Mauro Scanu
United Nations Economic Commission for Europe Statistical Division Part B of CMF: Metadata, Standards Concepts and Models Jana Meliskova UNECE Work Session.
Metadata Models in Survey Computing Some Results of MetaNet – WG 2 METIS 2004, Geneva W. Grossmann University of Vienna.
1 1 Improving interoperability in Statistics Some considerations on the impact of SDMX 59th Plenary of the CES Geneva, 14 June 2011 Rune Gløersen IT Director.
Metadata-driven Business Process in the Australian Bureau of Statistics Aurito Rivera, Simon Wall, Michael Glasson – 8 May 2013.
United Nations Economic Commission for Europe Statistical Division Introduction to Steven Vale UNECE
Panel discussion questions for Session ii. Panellists Dan Gilman (BLS) – BLS are an associate member of the DDI Alliance Eric Rodriguez (INEGI) Achim.
Statistical Metadata Strategy and GSIM Implementation in Canada Statistics Canada.
DDI Discovery: An Overview of Current RDF Vocabularies Arofan Gregory Metadata Technologies NA Joachim Wackerow GESIS.
Introduction to DDI Moving Forward Dagstuhl Seminar October 22-26, 2012.
Survey Data Management and the Combined Use of DDI and SDMX Arofan Gregory Chris Nelson Metadata Technology Eurostat, June
Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,
SDMX IT Tools Introduction
Metadata Working Group Jean HELLER EUROSTAT Directorate A: Statistical Information System Unit A-3: Reference data bases.
1 SDMX Global Conference September 2015 SDMX into the future VTL (Validation and Transformation Language) A new technical standard for enhancing.
ABS Issues for DDI Futures Bryan Fitzpatrick October 2012.
Aim: “to support the enhancement and implementation of the standards needed for the modernisation of statistical production and services”
Strategic Priorities for DDI Spring 2013 Mary Vardigan Director, DDI Alliance METIS -- Geneva, Switzerland May 6, 2013.
GSIM, DDI & Standards- based Modernisation of Official Statistics Workshop – DDI Lifecycle: Looking Forward October 2012.
United Nations Economic Commission for Europe Statistical Division Enhanced Generic Models to Support the Standardisation of Statistical Production Steven.
1 1 Improving interoperability in Statistics Some considerations on the impact of SDMX MSIS 2011 Luxembourg 23 – 25 May 2011 Rune Gløersen IT Director.
1 Joint UNECE/EUROSTAT/OECD METIS Work Session (Geneva, March 2010) The On-Going Review of the SDMX Technical Specifications Marco Pellegrino, Håkan.
ESTP Course on the EGR November FATS user interface and metadata of final frame.
GSIM-variables Modernisation Comittee on Strandards.
ROMA 23 GIUGNO 2016 MODERNISATION LAB - FOCUSSING ON MODERNISATION STRATEGIES IN EUROPE: SOME NSIS’ EXPERIENCES Insert the presentation title Modernisation.
DDI and GSIM – Impacts, Context, and Future Possibilities
Contents Introducing the GSBPM Links to other standards
Exchanging Reference Metadata using SDMX
Generic Statistical Business Process Model (GSBPM)
11. The future of SDMX Introducing the SDMX Roadmap 2020
GSBPM, GSIM, and CSPA.
Logical information model LIM Geneva june
GSIM The Generic Statistical Information Model
The Generic Statistical Information Model
August Götzfried Eurostat unit B 4
Presentation to SISAI Luxembourg, 12 June 2012
Standards and guidelines for reference metadata
Quality reporting in the ESS - State of play and next steps
Generic Statistical Information Model (GSIM)
Introducing the Data Documentation Initiative
DDI and GSIM – Impacts, Context, and Future Possibilities
Presentation transcript:

GSIM Mapping to SDMX and DDI: Preliminary Findings and Status Arofan Gregory Metadata Technology METIS, May , Geneva

Outline Working process Goals Business Group Concepts Group Production Group Structures Group Conclusions

Working Process Group includes representatives from NSIs, international organizations, central banks, and standards bodies – Includes active implementers Meets bi-weekly via conference calls Split into two groups – GSIM-DDI and GSIM SDMX Significant cross-membership to ease coordination

Goals GSIM 1.0 had some initial mappings against various standards (incl. DDI and SDMX) – This is the basis of the current work Will produce a mapping table from GSIM to DDI, GSIM to SDMX Locate gaps for each standard, provide feedback to standards bodies Find any gaps in the GSIM model itself Support the GSIM “plug & play” cases

Design Principles Support from one standard is enough – Both DDI and SDMX do not need to support everything No “forced” mappings – If strong semantics don’t exist, identify as a gap

Business Group Statistical Activity and Design – Not well-supported by DDI, but support should be better in future versions – SDMX has a very generic process model Data collection area is well-supported by DDI, little or no coverage from SDMX Specification of needs – DDI is weak, documentary not machine-actionable – Requirements will be passed to the DDI Alliance – Could use SDMX Reference Metadata to support this, but no explicit support

Concepts Group Major gap: classification management Otherwise, good support from DDI Reasonable support from SDMX but no distinction between codes and categories Populations, statistical units not well supported We expect strong alignment with future versions of DDI (some changes already to DDI 3.2 in public review)

Production Group Not good “actionable” metadata in SDMX or DDI Gaps here are not critical – Other standards support this better BPMN BPEL We expect better support from DDI in future – DDI 3.2 offers some better support than 3.2 SDMX has a process model, but not as much detail

Structures Group The best coverage for GSIM is in this part of the model – Data sets – Data structures This is the key metadata from the standards perspective – Also for many implementations Dissemination better described by SDMX than by DDI – We do not expect DDI to support this function

Conclusions Fair coverage by standards in some areas Identified gaps will, where necessary, result in requirements being passed to the standards organizations Further work is needed to complete the mapping/analysis GSIM will provide a good model for convergence of standards in future