>> Dissemination databases and PC-Axis in Statistics Denmark Lars Knudsen Statistics Denmark

>> What will be presented…  Demo of  Ingredients in the PX-family  Input and editing software  Questions and discussion

>> General info about the StatBank  About 3500 tables/cubes/matrices  Billions of time series (many zeros)  GB raw data (excl. zero-values)  though)  4-5 news releases a day  Large multidimensional tables (up to 16 variables, recommend max. 8)

>> Common functionality… Similar  Documentation (Declaration of contents for statistics)  Related publications  Search  Contextual Help function  Etc…

>> Demo

>> Selected features of the StatBank (1)  User profile and saved queries stored on server  DataShooting and batch  Dynamic XML access (incl. graphs) and Excel Web Queries  Web Services

>> Selected features of the StatBank (2)  User and pre-defined aggregations and pick- lists (goes with saved queries)  Month/quarter to year aggregation on the fly  Advanced selection (search by code/text etc.)  Elimination of variables

>> Selected features of the StatBank (3)  SmartTableView (automatic pivot)  Time series output  Graphs and maps for "all" tables  Many output formats (from pc-axis)  Print and Sort data  Sorting function  Eliminate zero-rows

>> Selected features of the StatBank (4)  Search results sorted by most used  Search includes synomyms, mis-spellings, search within result etc.  Search by "alias" in URL  Access subjects, tables and queries by "alias"

PC-Axis software family overview… PC-Axis main modul PX-Batch macro & micro PX-iMap PX-Publ PC-Axis sql macro & micro PX-Map PX-Make PX-Edit PX-Web PX-Tool PX-Check … PX-iGraph PC-AXIS file format

>> Features of PC-Axis system  Easy to re-arrange table  Make calculations in a simple way  Exporting to other file formats  Making graphics very fast  Link to PX-Map  Use standard aggregation lists  Multiple language support  Etc … etc …

PX-MAP Create maps from PX-files or csv-files Changing map appearance Eksport map to reports etc. Good for data overview

>> Features of PX-Web  Powerfull statistical dissemination system  Easy to implement and getting started  Minimal system requirements  Example Example

>>

>> Database- vs. Fileserver system  What database structure?  Redundant metadata with many files single source system  PX-Web 2012 can handle both

>> File server system

>> Data model

>> CPR BBR  Loader Software SumDataBase (Oracle) PX-Publ PC-AXIS SQL StatBank Denmark PDF (www) Paper *.xls *.dbf *.csv etc... Users (DataShoot) TimeSeries PX / PXS files Word Excel Visual Basic / ASP and Oracle Forms Registers Production System Overview... www dst dk  SAS MainFrame SuperStar etc...

>> SumDataBase (Oracle) FireWall Internet Database 1 Internet Database 2 Internet Server 1 Internet Server 2 User Adm. Database Web Switch SumDataBase / StatBank Denmark Overview One Internet Database is active, while the other is inactive They shift every day at 9.30, releasing new figures. Internet Server 3

>> Consistency with publications  One source serving multiple needs  Prepare publications using PX-Publ with data from dissemination system (unreleased version)  Easy updating  Error checking

>> Input and editing tools…

Public and private metadata Divisions and databanks have devided access to metadata depending on the nature Public metadata: SumTimes SumTimes Private metadata: SumTools

>> SumTools

>> Features to make it easier  Record Layout  Batch function for SumTools  PC-Axis and Web interface to ’not-released-data’  Automatic release ’on time’  Validation and log-files

>> Our implementation  The common datamodel + a few extra tables for ”user control”  Oracle, ASP (VB-Script) and JavaScript  Developed in-house, using common PC-Axis components (PX-Web)  Lithuania and Ireland

>> Organizing metadata work Jacob Chr. Solander 2013

>> Who do what?  Dissemination Centre and the subject matter divisions work very closely together  Yearly meetings 34  5 contact person in Dissemination Centre  13 Subject matter divisions  12 Subject areas  3000 tables in the statbank.dk

>> Centralized Vs. Decentralized  Decentralized updating of data, table headlines and contact information  Centralized updating of metadata and codes  To ensure consistency throughout the statbank and  Reuse of metadata 35  Municipalities  Country names and codes  NACE - Industry codes  Other standard codes

>> Creating value pooles (VP)  Few value pooles (VP)  From where a lot of value sets (VM) are made. 36 Value poole for Regions, municipalities and country parts (VPxxx) Value set for regions (VMxxx) Value set for regions and municipalities (VMxxy) Value set (VMx)

>> From the idea to the final table  By or phone  or a meeting 37  Disseminations centre  Request from the subject matter divisions  Subject matter divisions  By or phone  or a meeting Reuse of metadata ? Sorting code ? English metadata ? Spreadsheet with info: English metadata ! Contact person ! Release date ! A new table Editing of a table Renaming an existing table

>> The final result as a table Using the metadata tool Presentations from Subject matter division From the idea to the final table 38

>> The metadata tool 39

>> Use of metadata in dst.dk  Metadata from the statbank are widely used in  E.g. Subject pages Key figures  Newsletter NYT 40 Metadata from statbank.dk

>> 41