Recent SDMX IT developments at the OECD SDMX Expert Group Meeting 13 - 14 September 2012 OECD, Paris By Jens Dossé and Jonathan Challener.

Slides:

Advertisements

Similar presentations

The use of SDMX at the ECB Xavier Sosnovsky European Central Bank Bonn,

Advertisements

13 September 2012 SDMX Technical Working Group1 Report of the SDMX Technical Standards Working Group SDMX Expert Group Meeting, Paris, September 2012.

Implementing SDMX exchange of national development indicators SDMX Expert Group Meeting, Paris, 13 – 14 September 2012.

1 OECD SDMX Expert Group Paris, September 2012 SDMX implementation in ISTAT: from a tactical approach to a strategic perspective Francesco Rizzo.

OECD Expert Group on Statistical Data and Metadata Exchange Geneva May 2007 OECD.Stat SDMX Web Service (II) Jens Dossé, OECD.

April, 2004 Lars Thygesen International Trade Expert meeting Whats going on at OECD: statistical information management.

MEETING TODAY’S DISSEMINATION CHALLENGES: Implementing international standards in.Stat Prepared by Jonathan Challener, OECD For MSIS, April Dublin,

© Metadata Technology ESCWA SDMX Workshop Session: Web Services SDMX REST Interface.

Building resource capacity within the SIS community by Jonathan Challener, OECD MSIS IOs meeting IMF HQ, Washington 24 May 2012.

Federal Department of Home Affairs FDHA Federal Statistical Office FSO Meeting of the OECD Expert Group on SDMX September, OECD, Paris Centralized.

CASE STUDY: IMPLEMENTING SDMX EXCHANGE WITH MEMBER COUNTRIES IN SHORT-TERM ECONOMIC STATISTICS (STES)

1 SDMX Reference Infrastructure (SDMX-RI) Work in progress, status and plans Bengt-Åke Lindblad, Adam Wroński Eurostat Eurostat Unit B3 – IT and standards.

Exchange of trade data using SDMX COMTRADE joint UNSD-OECD project 9 January 2007.

SDMX Data Structure Definition for BPM6 and EBOPS Working Party on International Trade in Goods and Trade in Services Statistics Paris, France November.

MSIS2013 By Jonathan Challener UPDATE ON THE ACTIVITIES OF THE OECD"S STATISTICAL INFORMATION SYSTEM COLLABORATION COMMUNITY.

SQL Forms Engine Koifman Eran Egri Ozi Supervisor: Ilana David.

Eurostat D.1 SdmxSource SDMX RI User Group Luxembourg, September 2013.

1 OECD Experience from SHA Collection 7th Meeting of Health Accounts Experts and Correspondents for Health Expenditure Data Paris, September, 2005.

Update on the activities of the OECD’s Statistical Information System Collaboration Community MSIS - May 2012.

Sdmx web services Strutural data

CountryData Development Improving the collation, availability and dissemination of development indicators (including the MDGs) Nairobi, 27 November 2013.

SDMX at the IMF Progress Report Expert Group on Statistical Data and Metadata Exchange (SDMX 2007), Geneva, May 8-11, 2007 Patrick Hinderdael, Economic.

Restricted Daejeon, April An SDMX based unified data catalogue (UDC) MSIS – Meeting on the Management of Statistical Information Systems 1.

CHRIS NELSON METADATA TECHNOLOGY WORK SESSION ON STATISTICAL METADATA GENEVA 6-8 MAY 2013 Designing a Metadata Repository Metadata Technology Ltd.

Implementing SDMX within Morocco’s Statistical Data Base (BDS) BY Mr. Houssam EL OUINKHIR : Computer developer and DBA oracle 1 UNSD-DFID Project:

How to implement an SDMX architecture for dissemination and reporting

Francesco Rizzo (ISTAT - Italy) SDMX ISTAT FRAMEWORK GENEVE May 2007 OECD SDMX Expert Group.

1 Exchange of data between OECD and Statistics Norway Marianne Vik Dysterud, Statistics Norway Meeting of the OECD Expert Group on Statistical.

Slide 1 Eurostat Unit B3 – Statistical Information Technologies CoRD Meeting – 4 June 2007 Agenda Item 8 Preliminary ideas for a 2011 census hub Giuseppe.

Situation of ANA data and metadata in 2008 Transmission to the OECD : progress report.

Eurostat B.3 Alignment to SDMX 2.1 SDMX RI User Group Luxembourg, September 2013.

Eurostat SDMX and Global Standardisation Marco Pellegrino Eurostat, Statistical Office of the European Union Bangkok,

Eurostat 4. SDMX: Main objects for data exchange 1 Raynald Palmieri Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October.

SDMX IT Tools SDMX Reference Infrastructure

Eurostat November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois LEBLANC Christian SEBASTIAN SDMX IT Tools SDMX.

The OECD-UNSD Trade System – A Progress Report OECD Trade Experts Meeting – September 2007.

ΕΚΤ Access to Knowledge ΕΚΤ Access to Knowledge R&D Statistics Information System: An Interoperability Tail between CERIF and SDMX Dimitris Karaiskos Dimitrios.

IAEA International Atomic Energy Agency Implementing SDMX for Energy Domain: From Discussion to Actual Implementation and Testing Andrii Gritsevskyi Oslo.

The Eurostat Metadata Handler Götzfried Eurostat (Head of Unit B6)

B.6 Roadmap 2013 – 2014 SDMX RI User Group Luxembourg, September 2013.

Statistical Information Systems Introducing SIS tool .Stat

National Accounts World Wide Exchange

The evolution of the SDMX infrastructure and services

Challenges & Opportunities

SISAI STATISTICAL INFORMATION SYSTEMS ARCHITECTURE AND INTEGRATION

SDMX Reference Infrastructure Introduction

SDMX Introduction and practical exercises

SISAI STATISTICAL INFORMATION SYSTEMS ARCHITECTURE AND INTEGRATION

2. An overview of SDMX (What is SDMX? Part I)

ESSnet on SDMX phase II June 7-8, Luxembourg.

Eurostat – Units E2, B5 Cristina BLANARU

2. An overview of SDMX (What is SDMX? Part I)

Statistical Data and Metadata eXchange (SDMX)

SDMX implementation at Eurostat and in the Member States

SDMX in the S-DWH Layered Architecture

SDMX Tools Overview and architecture

ESTP WORKSHOP ON SDMX IN NATIONAL ACCOUNTS

SDMX for MDG Indicators

Ioannis Xirouchakis / Unit B3

SODI Live Demonstration

2nd SISAI meeting Luxembourg, June 2012

Jean-Francois LEBLANC Christian SEBASTIAN

Eurostat Unit B3 – IT and standards for data and metadata exchange

Eurostat Unit B3 – IT and standards for data and metadata exchange

Eurostat Unit B3 – IT and standards for data and metadata exchange

Validation Activities in the ESS What you will hear today…

Developing SDMX artefacts for data exchange, sharing and dissemination

14. SDMX: Global and regional implementation projects

SDMX IT Tools SDMX Registry

A non-statistical data exchange scenario

Presentation transcript:

Recent SDMX IT developments at the OECD SDMX Expert Group Meeting September 2012 OECD, Paris By Jens Dossé and Jonathan Challener

Current SDMX web service features in.Stat (1) DSD 2.0: soap + rest Generic data 2.0: soap + rest Compact data 2.0: soap MSD 2.1: soap Generic metadata 2.1: soap

Current SDMX web service features in.Stat (2) Full streaming (data messages) SSO authentication + authorization HTTP compression Incremental updates Dynamic generation of DSD, MSD and schema for compact message

Implementation of version 2.1 So far: –MSD and metadata message: most urgent since 2.0 lacked flexible attachment levels Whats next: –Full implementation through SDMX-RI integration Joint effort by SIS-CC especially ISTAT Mapping from dissemination db to agreed SDMX structures SDMX 2.1 web service Local registry

Improving security of SDMX web services 3-tier architecture within.Stat SQL injection protection Denial of service protection: - limitation to non-concurrent requests - limitation in maximum data size

Improving error messages in SDMX web services SOAP WS returns SDMX-defined SOAP errors REST WS return SDMX-defined HTTP errors Challenge: –Implementation of SDMX faultcode specification in soap errors sdmxerror:500

Unit and power code information in SDMX data messages Defined in.Stat at different levels: –Dataset, –specific unit dimension, –codes of 1 dimension, –combination of codes of more than 1 dimension (e.g. country x measure, series), Represented as attributes at series level, Internally coded through common dimension, but not yet mandatory.

Technical improvements for voluminous SDMX data messages SQL code optimisations –SQL and web server timeouts –Performance

Work plan outlook Further improvements to management of units and other attributes Contribution to.Net version of SDMX-RI implementation by Eurostat (architecture and testing) and its Integration in.Stat (2.1) Early implementation of upcoming beta SDMX- JSON output/web service Implementation of SDMX data collection Imports of SDMX 2.1 data into.Stat