XML-publication in Finnish Labour Force Survey (LFS) ESTP training course on Data Dissemination and Publication of Statistics Madrid, Kalle Sinivuori

Kalle Sinivuori Finnish Labour Force Survey It is a continuous panel survey based on a sample of about 12,000 persons per month. Sampling units : individuals Field interviewers collect the LFS data using computer aided telephone interviews (Blaise) The data is available approximately three to four weeks from the reference time period. Periodicity of the results: monthly, quarterly and annually Monthly press release, www-tables and -figures, pdf- and paper publication.

Kalle Sinivuori Revision of the publication process (LFS) - background Revision of the statistical production system in => Shift from the oldest technology to the latest technology => From mainframe to open environment Need to change the publication process as well Old publication process was clumsy : troublesome to update and based on mainframe.

Kalle Sinivuori Revision of the publication process in context of Statistics Finland Production model project in years => New production model of Statistics Finland New XML-based publication process was defined and tools for new publication process were selected (=> but not implemented). CoSSI: Common Structure of Statistical Information => Based on fact: statistical information has a certain simplifiable and acceptable universal structure ;

Kalle Sinivuori Reasons to use XML => from Final Report of Production model -project Possibility to add distribution channels without changing the publication process Independence of (certain) software's ~ XML is suitable format for archiving statistical information XML makes possible wide-ranging metadata to describe statistical information and statistical publications XML creates good possibilities for integration between different applications

Kalle Sinivuori Web-site Publication production (Monthly & quarterly publ, publication tables...) FastWeb -Timer controlled Database services StatFin Database HTML Paper Publi- cation Publication editor Word, Excel, Statistical application Mainframe Automatical publishing -Timer controlled Excel - manually and - automaticly Conversion to PDF LFS - old dissemination process Stat Build Excel - manually and - automaticly Word: - Conversion to HTML

Kalle Sinivuori What we need(ed) More and better metadata Language versions All information in a single file Archiving Automatical conversion to different dissemination channels Structured searches To add new dissemination channels

Kalle Sinivuori / XML based dissemination process – XML and PC-Axis PX-Web: PC-Axis tables Publishing and preview FastWeb-XML Conversion Database services PX-Web HTML PDF RSS, SDMX Dissemination database eXist, XML- database Statistical application SAS -> PX&CoSSI SuperStar -> PX&CoSSI PX-Edit -> PX&CoSSI Publication editor Arbortext Monthly & quarterly publ, publication tables...) Metadata: - statistical metadata - classifications - processing metadata eXist, XML- database Web-site HTML PDF RSS, SDMX.PX Printing house PDF

Kalle Sinivuori LFS New publication process started from may 2007

Kalle Sinivuori PX-Web: matrices (PXML) Publishing and preview FastWeb-XML Conversion Database services PX-Web HTML PDF RSS, SDMX Dissemination database eXist, XML- database Statistical application SAS -> PX&CoSSI SuperStar -> PX&CoSSI PX-Edit -> PX&CoSSI Publication editor Arbortext Monthly & quarterly publ, publication tables...) Metadata: - statistical metadata - classifications - processing metadata eXist, XML- database Web-site HTML PDF RSS, SDMX.xml / XML based dissemination process – integration completed Printing house PDF

Kalle Sinivuori Future of XML-publishing in Statistics Finland So far 39 statistics have implemented SAS to XML - publishing process, which was developed in LFS. During 2008 most of the statistics (about 200 in Statistics Finland) are implementing xml-publishing. For technical details: ask (Head of IT-development/ Dissemination) (Technical expert / ) (Head of the Data Dissemination sect.)