1. How to implement an SDMX architecture for dissemination and reporting
Alessio Cardacino
ISTAT
SDMX-RI User Group – Luxembourg september 2013

2. The Istat approach on SDMX
ESSnets
SDMX-RI
SDMX Istat Strategy
collaborative sharing of knowledge and software
beyond the data exchange
getting experience from ESS pilot exercises
SODI
Demography
EGR
Census Hub
SDMX
for standardization
and industrialization
(Stat2015)
Istat has been working on SDMX since 2004.
At the beginning, in order to get experience, Istat has participated to some pilot projects launched by Eurostat within the European Statistical System:
SODI (SDMX Open Data Interchange) – extended the STS database and developed a SDMX web service;
Demography Rapid Questionnaire – developed the SDMX Istat Framework as a set of build blocks to be used to disseminate/providing data in SDMX format;
EuroGroup Register – developed an extension of the SDMX Istat Framework, that was used by other NSIs during the pilot phase;
Census Hub – installed a pilot architecture based on the SDMX-RI. In this context Istat participated from the very first beginning to the design of the SDMX-RI.
From 2009 to 2012, Istat has participated to ESSnets on SDMX phase 1 and phase 2, contributing to the development of software and guidelines shared within ESS members.
From 2010, with the starting of the multiannual program Stat2015, SDMX has become one of the strategic standards that would have facilitated the harmonization of the content and the industrialization of the process. In this context it has been analyzed the way of moving beyond the simple use of SDMX as a standard for more efficient processes for exchange data among international organizations and their members, and to exploit all its potentialities in handling and disseminating data and metadata.

3. SDMX-RI Adapting Using Reusing The SDMX-RI in Istat Dissemination:
ISTAT’s SEP
Reporting
Census Hub
OECD STES
ICT VIP
ESA2010 (NA)
…….
WS Enhancement
Tight coupling integration with .STAT
SDMX-RI
Excel plugin
Windows client
RSS feeder
Structural metadata gui
Smartphone and tablets
RDF,DSPL adapters
When the SDMX-RI has been build up Istat decided to use it in two different way: using it and re-using some part of the modules to implement new software all around the SDMX-RI for internal purposes
Reusing

4. The overall architecture

5. Financing the implementation: Eurostat – Istat grant
Total estimated cost: ,87 €
Duration: 24 months (Dec 2012 – Dec 2014)
24 deliverables split among 4 work packages:
WP1 – Coordination
WP2 – Enhancement of the SDMX-RI, and its integration into the Istat information system
WP3 – Enhancement of the Istat Metadata Management System
WP4 – Contribution to the development of SDMX standard and implementation of capacity building actions
2 Directorates, 3 Services and 7 Units involved (19 internal people involved for a total of 778 man/days)
> 1000 man/days subcontracting

6. Streamlining the workflow
Data Reporting
Metadata
&
mapping
repository
OECD
EUROSTAT
DSDs
SDMX
SEP
Mapping
Assistant
DSW
DSDs
Data Dissemination
I.STAT 6

7. Structural metadata Web GUI

8. Excel plug-in

9. Excel plug-in

10. Excel plug-in

11. SDMX Structural Metadata web GUI ver 1.0
State of the art: already available
Excel plugin ver 1.0
Windows client ver 1.0
SDMX Structural Metadata web GUI ver 1.0
Software for the tight coupling integration between SDMX-RI (intermediate version) and .Stat:
Mapping Assistant ver
Web Service ver 2.4.3 11

12. RSS feeder (for SDMX-RI and .Stat) ver. 2.0
State of the art: in progress
RSS feeder (for SDMX-RI and .Stat) ver. 2.0
Enhanced version of the SDMX-RI web service (based on the intermediate version of the SDMX-RI)
Tight coupling integration between SDMX-RI (ultimate version, based on the sdmx Common APIs) and .STAT
Excel Plugin ver 2.0 12

13. Tools for the generation of open data formats as RDF and Google DSPL
State of the art: in progress
Tools for the generation of open data formats as RDF and Google DSPL
App client for tablets and smartphones 13

14. Thank you for the attention14