1. XML-publication in Finnish Labour Force Survey (LFS) ESTP training course on Data Dissemination and Publication of Statistics Madrid, 3.-5.3.2008 Kalle Sinivuori (kalle.sinivuori@stat.fi)

2. 5.3.20082Kalle Sinivuori Finnish Labour Force Survey It is a continuous panel survey based on a sample of about 12,000 persons per month. Sampling units : individuals Field interviewers collect the LFS data using computer aided telephone interviews (Blaise) The data is available approximately three to four weeks from the reference time period. Periodicity of the results: monthly, quarterly and annually Monthly press release, www-tables and -figures, pdf- and paper publication.

3. 5.3.20083Kalle Sinivuori Revision of the publication process (LFS) - background Revision of the statistical production system in 2002-2006 => Shift from the oldest technology to the latest technology => From mainframe to open environment Need to change the publication process as well Old publication process was clumsy : troublesome to update and based on mainframe.

4. 5.3.20084Kalle Sinivuori Revision of the publication process in context of Statistics Finland Production model project in years 2003-2006 => New production model of Statistics Finland New XML-based publication process was defined and tools for new publication process were selected (=> but not implemented). CoSSI: Common Structure of Statistical Information => Based on fact: statistical information has a certain simplifiable and acceptable universal structure ; www.stat.fi/cossiwww.stat.fi/cossi

5. 5.3.20085Kalle Sinivuori Reasons to use XML => from Final Report of Production model -project Possibility to add distribution channels without changing the publication process Independence of (certain) software's ~ XML is suitable format for archiving statistical information XML makes possible wide-ranging metadata to describe statistical information and statistical publications XML creates good possibilities for integration between different applications

6. 5.3.20086Kalle Sinivuori Web-site Publication production (Monthly & quarterly publ, publication tables...) FastWeb -Timer controlled Database services StatFin Database HTML Paper Publi- cation Publication editor Word, Excel, Statistical application Mainframe Automatical publishing -Timer controlled Excel - manually and - automaticly Conversion to PDF LFS - old dissemination process www.stat.fi Stat Build Excel - manually and - automaticly Word: - Conversion to HTML

7. 5.3.20087Kalle Sinivuori What we need(ed) More and better metadata Language versions All information in a single file Archiving Automatical conversion to different dissemination channels Structured searches To add new dissemination channels

8. 5.3.20088Kalle Sinivuori / XML based dissemination process – XML and PC-Axis PX-Web: PC-Axis tables Publishing and preview FastWeb-XML Conversion Database services PX-Web HTML PDF RSS, SDMX Dissemination database eXist, XML- database Statistical application SAS -> PX&CoSSI SuperStar -> PX&CoSSI PX-Edit -> PX&CoSSI Publication editor Arbortext Monthly & quarterly publ, publication tables...) Metadata: - statistical metadata - classifications - processing metadata eXist, XML- database Web-site www.stat.fi HTML PDF RSS, SDMX.PX Printing house PDF

9. 5.3.20089Kalle Sinivuori LFS New publication process started from may 2007

10. 5.3.200810Kalle Sinivuori PX-Web: matrices (PXML) Publishing and preview FastWeb-XML Conversion Database services PX-Web HTML PDF RSS, SDMX Dissemination database eXist, XML- database Statistical application SAS -> PX&CoSSI SuperStar -> PX&CoSSI PX-Edit -> PX&CoSSI Publication editor Arbortext Monthly & quarterly publ, publication tables...) Metadata: - statistical metadata - classifications - processing metadata eXist, XML- database Web-site www.stat.fi HTML PDF RSS, SDMX.xml / XML based dissemination process – integration completed Printing house PDF

11. 5.3.200811Kalle Sinivuori Future of XML-publishing in Statistics Finland So far 39 statistics have implemented SAS to XML - publishing process, which was developed in LFS. During 2008 most of the statistics (about 200 in Statistics Finland) are implementing xml-publishing. For technical details: ask Harri.Lehtinen@stat.fi (Head of IT-development/ Dissemination) Heikki.Rouhuvirta@stat.fi (Technical expert / ) Markku.Huttunen@stat.fi (Head of the Data Dissemination sect.)