Presentation is loading. Please wait.

Presentation is loading. Please wait.

MEETING TODAY’S DISSEMINATION CHALLENGES: Implementing international standards in.Stat Prepared by Jonathan Challener, OECD For MSIS, April 2014 - Dublin,

Published bySamantha Clover Modified over 9 years ago

Similar presentations

Presentation on theme: "MEETING TODAY’S DISSEMINATION CHALLENGES: Implementing international standards in.Stat Prepared by Jonathan Challener, OECD For MSIS, April 2014 - Dublin,"— Presentation transcript:

1 MEETING TODAY’S DISSEMINATION CHALLENGES: Implementing international standards in.Stat Prepared by Jonathan Challener, OECD For MSIS, April 2014 - Dublin, Ireland

2 Doesn’t non-standard power supplies make things difficult?

3 What happens when standards are not applied well?

4 Picture: ‘The day Sweden changed from left-hand drive to right’ Confusion entails

5 This all adds up…

6 …high costs…

7 and inefficiencies!

8 “A little like the grade 8 student who doesn’t pay attention in class all year”.

9 WHAT IS.STAT?

10 What is.Stat?.Stat is the central repository ("warehouse") of validated statistics and related metadata.Stat is the central hub connecting data production, sharing & dissemination processes It is the corporate source of data for data sharing and dissemination purposes

11 What is.Stat?.Stat is the central repository ("warehouse") of validated statistics and related metadata.Stat is the central hub connecting data production, sharing & dissemination processes It is the corporate source of data for data sharing and dissemination purposes “.Stat is now being used and shared with 10 organisations including the OECD, as part of the Statistical Information System Collaboration Community (SIS-CC)”.

12 .Stat Positioning in Statistical Information System DATA DELIVERY INTERNAL DATA SHARING DATA DISSEMINATION DATA PRODUCTION.STAT

13 .Stat Positioning in Statistical Information System DATA DELIVERY INTERNAL DATA SHARING DATA DISSEMINATION DATA PRODUCTION.STAT “The diagram illustrates the.Stat contribution to the SIS processes..Stat’s core value-added lies in “Data Delivery”, a set of functions that enable dissemination and data sharing, and “Data Upload”, a set of functions interfacing data production processes into a single upload mechanism to feed dissemination channels”.

14 .Stat Functional Representation.STAT DATA DELIVERY ENGINE.STAT DATA DELIVERY ENGINE DATA PRODUCTION DATA SHARING DATA DISSEMINATION SEARCH ENGINES DATA ANALYSIS TOOLS P C WEBSITES, APPS PUBLICATIONS.STAT BROWSER.STAT DATA UPLOAD ENGINE FILE UPLOAD FILE UPLOAD SDMX IMPORT DATA PRODUCTION TOOLS TABLE & CHART EXTRACTION SERVICES RELEASE MGT SERVICES RELEASE MGT SERVICES.STAT BROWSER CONFIGURATION.STAT BROWSER CONFIGURATION DATA EXTRACTION SERVICES DATA EXTRACTION SERVICES SDMX INPUT E P BATCH UPLOAD SDMX GLOBAL REGISTRY PUBLISHING BACK OFFICE DATA MAPPING SDMX OUTPUT X X.Stat Component Process Human user Data Producer Data Editor Data Consumer API or Webservice Other SDMX hubs

15 .Stat Functional Representation.STAT DATA DELIVERY ENGINE.STAT DATA DELIVERY ENGINE DATA PRODUCTION DATA SHARING DATA DISSEMINATION SEARCH ENGINES DATA ANALYSIS TOOLS P C WEBSITES, APPS PUBLICATIONS.STAT BROWSER.STAT DATA UPLOAD ENGINE FILE UPLOAD FILE UPLOAD SDMX IMPORT DATA PRODUCTION TOOLS TABLE & CHART EXTRACTION SERVICES RELEASE MGT SERVICES RELEASE MGT SERVICES.STAT BROWSER CONFIGURATION.STAT BROWSER CONFIGURATION DATA EXTRACTION SERVICES DATA EXTRACTION SERVICES SDMX INPUT E P BATCH UPLOAD SDMX GLOBAL REGISTRY PUBLISHING BACK OFFICE DATA MAPPING SDMX OUTPUT X X.Stat Component Process Human user Data Producer Data Editor Data Consumer API or Webservice Other SDMX hubs “The grey shaded boxes in the figure below show a visual representation of how.Stat fits within a broader Data Dissemination Information System of organisations; the boxes with dotted lines represent other components of the Data Dissemination Information System that are not supported by.Stat but are enabled by it”.

16 .Stat Functional Representation In particular,.Stat provides the following 3 key functional areas…

17 .Stat Functional Representation.Stat Data Upload Engine

18 .Stat Functional Representation.Stat Data Delivery Engine

19 .Stat Functional Representation.Stat Data Browser

20 .Stat Positioning in GSBPM Reference Model

21 “.Stat can be mapped today to the Generic Statistical Business Process Model (GSBPM) under “Disseminate” and “Build”. In the future it will also incorporate archive functions as part of the over- arching process for data and metadata management”.GSBPM

22 Multipurpose SDMX within.Stat…

23 For dissemination and data eXchange SDMXWS and RESTful API SDMX 2.0 compliant SOAP + REST Pull SDMX-ML SDMX Structural metadata created on the fly

24 For ‘Open Data’ dissemination SDMX-JSON (beta) SDMX-TWG agreed in mid 2013 on proposal for data and their structural metadata (inc. flat & sliced layouts) and referential metadata (dataset, series, obs) as annotations. Further enhancements to come: Complete data structures and referential metadata

25 For data reporting SDMX-Reference Infrastructure (RI)* SDMX 2.0 and 2.1 compliant SOAP + REST SDMX Common APIs (SdmxSource.NET) Pull + Push SDMX-ML, GESMES, CSV Structural metadata stored in mini registry One web service - several mapped database instances Mapping Store DB XXX.Stat Data warehouse XXX.Stat Data warehouse SDMX-RI Web Service Dissemination Mapping Assistant SDMX-RI * The integration of SDMX-RI in.Stat is based on collaboration with Eurostat, provider of the SDMX-RI component with ISTAT taking the lead on behalf of the OECD’s Statistical Information System Collaboration Community.

26 For internal data sharing DirectAccess Restful SDMX query Flat data, flags, units Referential metadata Excel-add-in DirectAccess (Rest SDMX) Native Excel pivot table Wizard to select data

27 For a decentralised publishing environment DataHub* One interface to the publishing tools Centralised reporting and auditing SDMX based structural metadata, and referential metadata management Flexible load tool that promotes ‘self publish’ for data custodians In-built checks and safeguards to minimise errors Manages security and access rights Can be extended to manage other outputs and not limited to.Stat * DataHub has been developed and integrated with.Stat by Statistics NZ, with an additional connection to the Fusion Registry for managing structural metadata through the definition of DSDs.

28 Future outlook…

29 Further SDMX artifact support

30 SDMX ingest (Import)

31 SDMX global registry API

32 SDMX-RDF data cube vocabulary pilot

33 “Explore further semantic web/linked data opportunities (SDMX-RDF data cube vocabulary). To be taken forward by ISTAT and ABS under the SIS-CC umbrella”.

34 Lower technology adoption costs Increased development consistency, simplicity and predictability Improved code reuse Reduced cost, time and effort to transition between different solutions We all know the… Reduced focus on infrastructure Ability to create composite interfaces that are tailored to the needs of specific task Improved application portability Enable faster time to market because it is easier to use off the shelf components and applications that can integrate and provide features for the solution

35 References 1.Operationalising.Stat in a decentralised publishing environment (DataHub) by Tony Breen SNZ : https://community.oecd.org/docs/DOC-68362 https://community.oecd.org/docs/DOC-68362 2.Building a scalable architecture (.Stat) by Jens Dosse OECD: https://community.oecd.org/docs/DOC-68363 https://community.oecd.org/docs/DOC-68363 3.SDMX-RI and.Stat integration by Francesco Rizzo Istat: https://community.oecd.org/docs/DOC-68696 https://community.oecd.org/docs/DOC-68696 4.SDMX-JSON API: http://stats.oecd.org/opendataapi/Index.htmhttp://stats.oecd.org/opendataapi/Index.htm

36 Jonathan Challener, OECD jonathan.challener@oecd.org @Challener MSIS - Dublin, 14-16 April 2014 Meeting today’s dissemination challenges: Implementing international standards in.Stat Thank you

Download ppt "MEETING TODAY’S DISSEMINATION CHALLENGES: Implementing international standards in.Stat Prepared by Jonathan Challener, OECD For MSIS, April 2014 - Dublin,"

Similar presentations

The SDMX Registry Model April 2, 2009 Arofan Gregory Open Data Foundation.

The SDMX Registry Model April 2, 2009 Arofan Gregory Open Data Foundation.
The use of SDMX at the ECB Xavier Sosnovsky European Central Bank Bonn, 2009-04-02.

The use of SDMX at the ECB Xavier Sosnovsky European Central Bank Bonn,
13 September 2012 SDMX Technical Working Group1 Report of the SDMX Technical Standards Working Group SDMX Expert Group Meeting, Paris, September 2012.

13 September 2012 SDMX Technical Working Group1 Report of the SDMX Technical Standards Working Group SDMX Expert Group Meeting, Paris, September 2012.
National Institute of Statistics, Geography and Informatics (INEGI) Implementation of SDMX in Mexico.

National Institute of Statistics, Geography and Informatics (INEGI) Implementation of SDMX in Mexico.
April, 2004 Lars Thygesen International Trade Expert meeting Whats going on at OECD: statistical information management.

April, 2004 Lars Thygesen International Trade Expert meeting Whats going on at OECD: statistical information management.
Recent SDMX IT developments at the OECD SDMX Expert Group Meeting 13 - 14 September 2012 OECD, Paris By Jens Dossé and Jonathan Challener.

Recent SDMX IT developments at the OECD SDMX Expert Group Meeting September 2012 OECD, Paris By Jens Dossé and Jonathan Challener.
1. Complete and integrated BI and Performance Management offering Complete and integrated BI and Performance Management offering Widespread delivery of.

1. Complete and integrated BI and Performance Management offering Complete and integrated BI and Performance Management offering Widespread delivery of.
Cloud platforms Lead to Open and Universal access for people with Disabilities and for All www.cloud4all.eu WP 203 - Federating repositories of Solutions.

Cloud platforms Lead to Open and Universal access for people with Disabilities and for All WP Federating repositories of Solutions.
Reproductions of this material, or any parts of it, should refer to the IMF Statistics Department as the source. IMF Statistics Department Louis Marc Ducharme.

Reproductions of this material, or any parts of it, should refer to the IMF Statistics Department as the source. IMF Statistics Department Louis Marc Ducharme.
1 SDMX Reference Infrastructure (SDMX-RI) Work in progress, status and plans Bengt-Åke Lindblad, Adam Wroński Eurostat Eurostat Unit B3 – IT and standards.

1 SDMX Reference Infrastructure (SDMX-RI) Work in progress, status and plans Bengt-Åke Lindblad, Adam Wroński Eurostat Eurostat Unit B3 – IT and standards.
HLG, 25-27 November 2013 By Jonathan Challener INTERNATIONAL COLLABORATION USE CASE: THE OECD’S STATISTICAL INFORMATION SYSTEM COLLABORATION COMMUNITY.

HLG, November 2013 By Jonathan Challener INTERNATIONAL COLLABORATION USE CASE: THE OECD’S STATISTICAL INFORMATION SYSTEM COLLABORATION COMMUNITY.
GSBPM and GSIM as the basis for the Common Statistical Production Architecture Steven Vale UNECE steven.vale@unece.org.

GSBPM and GSIM as the basis for the Common Statistical Production Architecture Steven Vale UNECE
The views expressed herein are those of the author and should not be attributed to the IMF, its Executive Board, or its management Meeting on the Management.

The views expressed herein are those of the author and should not be attributed to the IMF, its Executive Board, or its management Meeting on the Management.
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.

WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and.

Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and.
Update on the activities of the OECD’s Statistical Information System Collaboration Community MSIS - May 2012.

Update on the activities of the OECD’s Statistical Information System Collaboration Community MSIS - May 2012.
CountryData Development Improving the collation, availability and dissemination of development indicators (including the MDGs) Nairobi, 27 November 2013.

CountryData Development Improving the collation, availability and dissemination of development indicators (including the MDGs) Nairobi, 27 November 2013.
SDMX at the IMF Progress Report Expert Group on Statistical Data and Metadata Exchange (SDMX 2007), Geneva, May 8-11, 2007 Patrick Hinderdael, Economic.

SDMX at the IMF Progress Report Expert Group on Statistical Data and Metadata Exchange (SDMX 2007), Geneva, May 8-11, 2007 Patrick Hinderdael, Economic.
Restricted Daejeon, 26-29 April 2010 1 An SDMX based unified data catalogue (UDC) MSIS – Meeting on the Management of Statistical Information Systems 1.

Restricted Daejeon, April An SDMX based unified data catalogue (UDC) MSIS – Meeting on the Management of Statistical Information Systems 1.
Statistisches Bundesamt eSTATISTIK.core: AN XML-BASED APPROACH TO DATA COLLECTION FROM ERP SYSTEMS Joint ECE/Eurostat/OECD Meeting on the Management of.

Statistisches Bundesamt eSTATISTIK.core: AN XML-BASED APPROACH TO DATA COLLECTION FROM ERP SYSTEMS Joint ECE/Eurostat/OECD Meeting on the Management of.

Similar presentations

Ads by Google